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1.  INTRODUCTION/BACKGROUND 


a.  INTRODUCTION 

The  final  report  of  the  Army/Navy  Computer  Family  Architecture  (CFA) 

Selection  Committee  consists  of  nine  volumes,  which  together  describe  the  background, 
activities,  and  technical  findings  leading  to  the  recommendation  by  that  Committee 
for  a computer  architecture  to  be  used  in  a family  of  software-compatible  military 
computers.  This  is  the  sixth  volume  of  that  report.  It  describes  the  methodology 
used  to  compute  life-cycle  costs  of  military  computer  implementations  based  on  CFA 
candidates  and  it  presents  the  results  of  applying  this  methodology  to  two  dif- 
ferent life-cycle  models. 

Volume  I explains  the  background,  rationale  and  organization  of  the  Computer 
Family  Architecture  (CFA)  effort. 

Volume  II  describes  the  technical  issues  addressed  by  the  Selection  Connittee 
for  preliminary  evaluation  of  the  architecture  candidates  and  describes  the  results 
of  that  technical  evaluation. 

Volume  III  describes  test  program  specification  and  development  and  the  ap- 
plication of  these  test  programs  to  evaluation  of  architectural  efficiency  of  CFA 
candidates. 

Volume  IV  presents  hardware  language  (ISP)  descriptions  of  the  candidate 
architectures  and  describes  the  ISP  interpreter  facility  used  to  simulate  and 
gather  data  from  the  test  program  runs. 

Volume  V addresses  the  determination  of  support  software  requirements  and 
the  evaluation  of  the  available  support  software  of  the  candidate  architectures 
with  respect  to  these  requirements. 

Volume  VII  addresses  the  financial,  technical,  and  legal  issues  arising  out 
of  discussions  with  the  owner/manufacturers  of  the  candidate  computer  architec- 
tures and  describes  the  outcome  of  these  discussions. 

Volume  VIII  describes  the  considerations  of  the  Selection  Committee  during 
the  final  selection  process  and  the  synthesis  of  the  architecture  evaluation  on 
data  that  formed  the  basis  for  the  final  selection. 

Volume  IX  addresses  controversial  issues  and  questions  that  arose  during 
the  course  of  the  CFA  effort. 

The  two  life-cycle  models  described  in  this  volume  are  called  the  Bottom-Up 
(BU)  and  Top-Down  (TD)  models.  These  models  were  originally  described  in  two 
separate  internal  reports  (SvirW76a),  (CornJ76a).  This  volume  merges  and  elabo- 
rates on  those  reports. 
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Section  z describes  the  mathematical  formulation,  input  data,  and  results  of 
the  bU  model.  This  model  was  developed  and  its  results  computed  by  William  R. 
Svirsky,  A1  Irwin,  and  Tom  Giles  of  System  Development  Corporation,  West  Long 
Branch,  ivew  Jersey,  under  the  sponsorship  and  direction  of  Aaron  H.  Coleman  of 
the  U.  S.  Army  Electronics  Command,  Ft.  Monmouth,  New  Jersey.  William  Svirsky 
wrote  most  of  the  description  contained  nerein. 

Section  i describes  the  mathematical  formulation,  input  data,  results  and 
error  analysis  of  tne  Tu  model.  Jonn  J.  Cornyn  and  William  R.  Smitn  of  the  Naval 
Research  Laboratory  formulated  tne  model.  J.  Cornyn  carried  out  tne  computations 
on  tne  NKL  PUr-iu  timesnaring  system  and  wrote  most  of  the  text. 

Three  candidate  architectures  were  compared  using  the  models;  the  IBM  370, 
tne  Digital  Equipment  Corporation  PDP-11,  and  the  Interdata  B/32.  The  BU  model 
predicted  that  the  PDP-ii  architecture  would  be  the  most  cost-effective  architec- 
ture for  the  military  embedded  computer  environment  in  almost  all  circumstances. 

The  TD  model  predicted  that  for  software-to-nardware  ratios  greater  than  about  one, 
tne  IBM  J/U  architecture  is  superior,  for  ratios  less  than  about  one-fourth  the 
Interdata  B/j2  architecture  is  best,  and  for  ratios  in  between  the  PDP-11  archi- 
tecture is  desirable.  Section  4 discusses  tne  results  of  the  models  and  explains 
the  differences  on  tne  basis  of  uncertainties  in  the  input  data  and  tne  debatable 
validity  of  some  of  the  models'  assumntions. 

R.  P.  Estell,  of  tne  Fleet  Combat  uirection  Systems  Support  Activity,  San 
Diego,  California,  and  Capt  Robert  P.  Saoin,  Project  Manager  of  the  SAM-D  Missile 
Systan,  Redstone  Arsenal,  Alabama,  contributed  to  the  formulation  of  the  life-cycle 
cost  methodology. 

b.  BACKGROUND 

At  the  third  nieeting  of  the  CFA  Selection  Committee,  on  1«-2D  February 
ly/b,  at  tne  Naval  Postgraduate  Scnool , Monterey,  California,  Dr.  Bruce  Wald 
(NRL)  addressed  the  Selection  Committee,  rie  urged  that  final  selection  of  the 
CFA  be  based  on  considerations  meaningful  and  convincing  to  DoD  management,  in 
particular  the  cost  oenefits/penalties  of  the  various  choices.  Consequently, 
a Final  Selection  Methodology  Subcommittee  was  established  (R.  Estell  (FCOSSA), 

R.  Saoin  (SAm-D),  and  W.  Smitn  (NRL),  chairman)  to  develop  a methodology  for 
including  cost  considerations  in  the  final  CFA  selection. 

At  the  fourth  Committee  meeting  on  2d-2y  February  at  NRL,  Washington,  D.C., 

W.  Smitn  presented  the  methodology  developed  by  the  Final  Selection  Methodology 
Subcommittee  [EsteR'/bj.  This  methodology  provided  the  approach  to  convert  com- 
puter resource  requirements  (processor  performance,  storage,  software)  into 
dollar  costs  and  to  derive  those  costs  for  the  life-cycle  requirements  of  rele- 
vant military  computer  uses.  In  particular,  he  proposed  that  this  methodology 
be  applied  to  a model  (later  designated  as  the  top-down  (TD)  model)  of  military 
computer  requirements,  based  on  extrapolating  trends  in  DoD  computer  resource 
requirements  and  expenditures.  The  Committee  accepted  this  approach. 

Subsequently,  at  a meeting  at  USAECOM,  Ft.  Monmouth,  N.J.,  A.  Coleman 
(ECOM)  proposed  to  W.  Smith  that  an  additional  computer  resource  requirements 
inodel  (later  designated  as  the  bottom-up  (BU)  model),  complementary  to  the  TD 
model,  be  used  to  compute  military  computer  life-cycle  costs.  The  BU  model  was 
based  on  specific,  individual  computer  systems  in  existing  or  planned  Army  ap- 
plications. The  System  Development  Corporation  (SDC),  under  contract  to  ECOM, 
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was  available  to  perform  the  BU  data  gathering  and  computations.  Since  it  was 
believed  that  the  use  of  both  the  TO  and  BU  models  would  help  to  check  the  con- 
sistency and  validity  of  the  results,  it  was  agreed  that  both  results  would  be 
presented  to  the  Selection  Committee  at  its  fifth  and  final  meeting  in  August 
IB  7b. 

In  order  to  assist  the  reduction  of  software  requirements  to  costs,  it 
was  furtner  agreed  that  SDC  would  attempt  to  gather  data  from  software  devel- 
opment projects  in  SUC  and  to  formulate  a support-software-availability/ 
software-development-cost  relationship  from  that  data.  The  results  were  sub- 
sequently used  in  the  reduction  of  both  models  to  life-cycle  costs. 
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2.  THE  BOTTOM-UP  MODEL 


a.  INTRODUCTION 

Section  2 provides  the  results  of  a life-cycle  cost  analysis  of  three 
competing  architectures  - IBM  370,  DEC  PDP-11,  and  Interdata  8/32-  as  applied  to 
fifteen  current  Army  embedded-computer  systems. 

As  indicated  in  the  Table  of  Contents,  Section  2 discusses  the  background 
events  leading  to  the  initiation  of  this  analysis,  describes  the  basic  approach 
or  methodology  used,  tabulates  the  results  obtained  and  presents  the  conclusions. 

b.  BACKGROUND 

At  the  4th  meeting  of  the  CFA  Selection  Committee  on  28/29  April  1976  at 
NRL,  Washington,  D.  C.,  W.  Smith  (NRL)  presented  a methodology  for  quantitative/ 
relative  evaluation  of  the  life-cycle  costs  of  the  DOD  computer  resource  require- 
ments as  a function  of  the  three  CFA  finalists  under  consideration  (EsteR76). 

In  addition,  a model  (later  designated  as  the  top-down  (TD)  model)  of  military 
computer  resource  requirements,  based  on  projections  of  trends  in  military  computer 
resource  expenditures  and  requirements,  was  proposed  to  be  used  in  conjunction 
with  the  methodology  for  computing  life-cycle  costs.  Subsequently,  A.  Coleman 
(ECOM  CENTACS)  proposed  a complementary  requirements  model  (later  designated  as  the 
bottom-up  (BU)  model)  for  military  computer  resources  based  on  specific,  individual 
embedded-computer  systems  (ColeA76a).  At  a meeting  on  17  May  1976  involving 
personnel  from  NRL,  ECOM  (CENTACS)  and  SDC,  it  was  agreed  that  the  life-cycle  cost 
analyses  to  be  presented  to  the  CFA  Selection  Committee  at  its  5th  meeting  in 
August  1976  would  include  both  the  TD  and  BU  models  (ColeA76b).  At  this  meeting, 
a model  prepared  by  SDC  for  CENTACS  (SvirW76b)  was  amended  to  serve  as  the  basis 
for  the  BU  model  described  in  this  report. 


c.  BASIC  APPROACH 
(1)  Overview 

The  computer  resource  life  cycle  cost  was  estimated  for  each  of  15  Army  em- 
bedded-computer systems  (employing  each  of  the  three  CFA  finalists)  and  for  all 
systems.  Estimates  were  made  for  1976  and  for  1985  production  procurements.  The 
lowest  cost  CFA  for  each  system  and  for  all  systems  was  selected  for  1976  and  1985 
procurements.  The  systems  are  designated  #1  to  i<15  and  are  listed  in  Table  2-1. 

As  shown  in  Table  2-1  these  systems  are  in  various  phases  of  their  life  cycle. 


(2)  Total  Life  Cycle  Cost 

The  computer  resource  life  cvcle  cost  for  a given  system  and  a specific  CFA 
is  defined  as: 


where  C^-j 


*"ij  ""  *^'^ij  ^ ^^'^ij 


= computer  resource  life  cycle  cost  of  system  i using 
architecture  j 


TABLE  2-1 


Army  Embedded  - Computer  Systems 


SYSTEM  f 

SYSTEM  MISSION 

LIFE  CYCLE  PHASE 

1 

Medioim  Search 

Engineering  Development 

2 

Medium  Command  & Control 

Initial  Production 

3 

Small  Search 

Conceptual  Phase 

4 

Large  Command  and  Control 

Limited  Production 

5 

Medium  Command  and  Control 

Advanced  Development 

b 

Large  Command  and  Control 

Advanced  Development 

7 

Small  Command  and  Control 

Advanced  Development 

b 

Large  Communications 

Engineering  Development 

9 

Small  Communications 

Engineering  Development 

lU 

Small  Communications 

Advanced  Development 

11 

Small  Special  Purpose 

Engineering  Development 

12 

Large  Data  Management 

Deployment 

13 

Medium  Search 

Advanced  Development 

14 

Medium  Data  Management 

Conceptual  Phase 

lb 

Small  Guidance  and  Control 

Cohceptual  Phase 

7 


Hw..  = hardware  life  cycle  cost  of  system  i 
^ using  architecture  j 

ASw. . = applications  software  life  cycle  cost 

^ of  system  i using  architecture  j 

(3)  Hardware  Life  Cycle  Cost  (LCC) 

(a)  Total  Hardware  LCC 

The  computer  hardware  life  cycle  cost  for  a given  system  using  a specific 
CFA  is  defined  as: 

= "i  Lh  (f'ij  ^ ^ SM.j)  iZ.Z) 

Where 


n^.  = number  of  units  to  oe  produced  for  system  i 

L.  = hardware  life  cycle  cost  factor,  i.e.,  ratio 
" of  total  hardware  life  cycle  cost  to  hardware 
acquisition  cost.  This  factor  is  assumed  to 
oe  Z tor  a lu-year  life  cycle 

P.  = processor  acquisition  cost  for  system  i using 
^ architecture  j 

main  memory  acquisition  cost  for  system  i using 
^ architecture  j 

SM. .=  secondary  memory  acquisition  cost  for  system  i 
^ using  architecture  j 

(b)  Processor  Acquisition  Cost 


The  processor  acquisition  cost  for  system  i using  architecture  j is  defined  as: 


"'■f 


K = constant  relating  to  processor  cost,  derived 
as  shown  below 


a^  = processor  speed  ratio  for  architecture  j for  system  i 
^ derived  from  architecture  test  data  as  described  in  the 
Appendix,  Section  Z.7 


Mr.  = operating  speed  in  MIPS*  required  for  system  i, 
derived  from  system  proponents 


*MIPS  = millions  of  instructions  per  second 


Equation  (;d.3)  and  Ko  are  derived  In  [SvirW76D]  from  equation  (2.4)  below; 
Ma,.,  = Ko  (cost)^-^  (2.4) 


- Ma.- 


(cost) 


a^  Mr.  stated  In  MIPS 

w • 


Ko  is  the  ratio 


Examination  of  recent  cost/speed  data  for  several  military  processors  shows 
that  speeds  of  0.5  MIPS  and  corresponding  processor  costs  of  $48,000  are  repre- 
sentative values.  Substituting  these  figures  into  equation  (2.7)  yields  a value  of: 

Ko  = 9.9x10"^^ 

Equation  (2.4)  can  be  restated  in  terms  of  cost,  P..,  as: 

• J 


substituting  K 


This  value  of  K is  used  in  subsequent  calculations  for  1976  processor  cost  estimates 
and  is  reduced  by  a factor  of  10  for  1985  processor  cost  estimates  based  on  an  as- 
sessment of  hardware  cost  reduction  over  the  next  decade. 

(c)  Main  Memory  Acquisition  Cost 

The  main  memory  acquisition  cost  for  system  i using  architecture  j is  defined  as: 


""tj  ■ ‘b  '“fj  '“"i' 


(2.10) 


where: 


MM^.  = main  memory  acquisition  cost  (dollars)  for  system  i 
using  architecture  j 

b^j  = static  storage  ratio  for  awcliitecture  j and  system  i, 

derived  from  the  arcnitectjire  test  results  as  described 
in  the  Appendix,  Section  2 '.7 

PM^  = main  memory  (in  bits)  required  for  program  storage  in 
system  i;  M.  is  derived  from  system  proponents;  P is 
estimated  fraction  of  M.  dedicated  to  program  storage 
vs.  data  storage 


= main  memory  (in  bits)  required  for  data  storage  in 
system  i;  M.  is  derived  from  system  proponents;  D is 
estimated  fraction  of  dedicated  to  data  storage  vs. 
program  storage 

c.  = cost  per  bit  of  main  memory  derived  from  the  study  of 
Air  Force  AuP  requirements  through  the  19au‘s  [SADPR74] 
and  Turn's  data  in  his  book.  Computers  in  the  19au's 
LTurnR74].  Examination  of  the  price  per  bit  of  recent 
militarized  memory  systems  indicates  an  average  cost  of 
4 cents  per  bit;  i.e.,  $500U  per  16K  byte  memory  module. 

Tnis  value  is  useo  in  1976  cost  estimates;  0.4  cents  is 
assumea  in  I9bb  cost  estimates. 

(d)  Secondary  Memory  Acquisition  Cost 

The  seconaary  memory  acquisition  cost  for  system  i using  architecture  j is 
defined  as; 

SM..  = C^  (d.  . P'Ma,.  + O'Ma.)  (2.11) 

I J d I J I I 

where; 

Sm.  . = secondary  memory  acquisition  cost  (collars)  for 

system  i using  architecture  j ij 

D. . = static  storage  ratio  for  architecture  j for  system  i, 

derived  from  the  architecture  test  results  as  described  ■ 

in  the  Appendix,  Section  2.7 

P‘Ha^=  secondary  memory  (in  bits)  required  for  program  • i 

storage  in  system  i;  Ma.  is  derived  from  system 

proponents  wnile  P'  is  the  estimated  fraction  of  ' 

Ma^  used  for  program  storage  vs.  data  storage 

0'Ma^.=  secondary  memory  (in  bits)  required  for  data  storage 

in  system  i;  Ma^  is  derived  from  system  proponents  i 

wnile  U'  is  the  estimated  fraction  of  secondary  mem-  i 

ory  used  for  data  storage  vs.  program  storage 

C = cost  per  bit  of  secondary  memory  derived  from  the 

study  of  Air  Force  AbP  requirements  through  the  lyau's 
[SAUPR74]  and  Turn's  data  LTurnR74]. 

Examination  of  the  price  per  oit  of  current  militarized  disc  systems  indicates 
an  average  cost  of  u.2  cents  per  oit,  e.g.;  a 3bM  bit  disc  system  at  $72,UuU. 

This  value  is  used  in  197b  cost  estimates;  a cost  reduction  of  10;1  in  the  next 
lu  years  is  assumed  so  that  a price  of  u.U2  cents  per  bit  is  used  in  198b  cost 
estimates. 

(4)  Applications  Software  Life  Cycle  Cost 

The  applications  software  life  cycle  cost  for  system  i using  architecture  j 
is  defined  as;  , 


I 


(2.1^) 


. 

1 


} 


where  Csj 


ASw. . = CSj 


cost  ($)  per  instruction  ot  applications  software 
for  architecture  j 


S = applications  software  size  (in  instructions)  for 
^ system  i,  derived  from  system  proponents 

L = applications  software  life  cycle  cost  factor,  i.e., 
* ratio  of  applications  software  life  cycle  cost  to 
initial  acquisition  cost 


Ls,  software  life  cycle  cost  factor,  was  taken  oasically  from  Fisher's  report 
LFish074,  p.b4]  which  places  modifications  and  retrofits  to  software  at  four  to 
five  times  the  cost  of  the  initial  product.  Thus  by  taking  the  midpoint  and 
adding  the  initial  cost  as  one,  we  have  a value  of  Ls  = b.b. 

Cs.,  cost  per  instruction  of  application  software  for  arcnitecture  j,  is  based 
on'^the  experience  of  System  Development  Corporation  with  five  large  scale  (24IC 
instructions  to  bCiDK  instructions)  software  efforts.  The  data  was  compiled  by 
sending  questionnaires  to  the  program  managers.  Program  managers  responded  with: 
the  cost  of  software  production,  the  number  of  instructions  produced,  and  for 
thirteen  software  tools  they  estimated  what  would  be  the  percent  increase  in 
project  cost  if  the  tool  were  not  available  and  now  much  less  the  project  cost 
would  be  if  the  ideal  tool  were  available.  From  generalizations  of  this  data, 
it  was  possible  to  construct  the  curves  shown  in  Figure  2-1. 

These  curves  show  the  variation  of  cost  per  instruction  as  a function  of  the 
Tool  Availability  Index  (TAl)  for  three  conditions;  (A)  worst  case,  (B)  best  case 
and  (C)  derived  median.  It  should  be  recognized  that  the  results  are  largely 
judgmental  and  that  examples  can  also  be  found  which  yield  costs  per  instruction 
above  and  below  the  worst  and  best  case  curves  of  Figure  2-1.  The  Tool  Availability 
Index  (TAI)  is  defined  as  the  ratio  of  available  software  tools  to  the  ideal  set 
ot  software  tools.  The  "ideal  set"  is  defined  in  a separate  report  by  the  Soft- 
ware Evaluation  metnodology  Subcommittee  [WagnJ7b]. 

By  knowing  the  TAI  for  a given  architecture  for  any  point  in  time,  one  can 
enter  Figure  2-1  and  obtain  an  estimated  cost  per  instruction.  As  the  percentage 
of  available  software  tools  increases  the  cost  per  instruction  of  application 
software  can  be  seen  to  diminish.  The  ly7b  TAI  for  each  CFA  finalist  was  derived 
from  the  report  of  the  Software  Evaluation  Committee  [WagnJ7b]  as  34%,  5U%  and  73% 
for  the  Interdata  B/32,  DEC  PDP-11  and  IBM  S/370  architectures,  respectively.* 

The  average  of  these  values  is  52%  and  is  indicated  graphically  in  Figure  2-1. 

The  cost  per  instruction  for  the  average  TAI  is  approximately  $25,  $10  and  $17 
for  conditions  A,  B and  C,  respectively. 


*A  subsequent  refinement  of  the  data  in  the  SEC  report  changes  these  percentages 
to  37%,  54%  and  77%.  The  changes  proved  to  have  no  significant  impact  on  the  data 
presented  herein. 

ii 
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COST  PER  INSTRUCTION  ($)  vs 


TOOL  AVAILABILITY  INDEX  {%) 

Figure  2-1 


d.  RESULTS 


I 


t 


(1)  System  Proponent  Data 

To  obtain  values  of  n. , Mr^ , M . , Ma^,  and  S^,  a letter  was  sent  from 
ECOM  to  fifteen  project  managers  requesting  values  for  their  particular  system. 
The  responses  are  tabulated  in  Table  1-1  . This  table  indicates  that: 

(a)  The  numoer  of  installations  required  (n.)  ranges  from  8 to  3325  per 
system  for  a total  of  6277  computers  foH  all  15  systems. 


(b)  MIPS  required  ranges  from  .02  for  System  #12  (Large  Data 
Management)  to  1.33  for  System  #1  (Medium  Search). 

(c)  Estimated  main  memory  used  for  programs  (PM.)  ranges  from 

.UOb  to  13.0  Mbits.  The  average  value  of  PI'V  is  2.3  Mbits  C 

or  approximately  2bbK  bytes  per  system. 

(d)  The  number  of  applications  software  instructions  (S.j)  varies 
from  luuo  to  3/o,UOO  per  systent.  The  average  value  of  S.j  is 
loo, ODD  instructions. 

(2)  Processor  Life  Cycle  Cost  , 

The  parametric  data  required  for  processo”  life  cycle  cost  computations  is 
shown  in  Table  2-3a.  The  processor  speed  ratio  (ajJ  is  computed  in  the  Appen- 
dix, Section  2.7,  from  the  architecture  test  lesults.  The  total  processor  life 
cycle  cost  for  each  system  was  computed  as  described  in  paragraph  2. 3. 3. 2 and  is 
shown  in  Table  2-3b  for  iy7b  and  19ob  procurements.  The  unit  processor  life 
cycle  cost  for  each  system  is  snown  in  Table  2-3c.  The  average  unit  processor 
life  cycle  cost  for  all  systems  ano  architectures  is  S«b,4uo  in  1976. 

The  average  unit  processor  life  cycle  costs  of  the  DEC  PDP-11  and  Interdata 
8/32  architectures  are  8.2i  and  b.4l.  oelow  tne  average;  the  cost  for  ISM  S/37D 
architecture  is  14. 5^  above  the  average. 

(3)  Main  Memory  Life  Cycle  Cost 

The  parametric  data  required  for  main  memory  life  cycle  cost  computation  is 
snown  in  Table  2-4a.  The  static  storage  ratio  (b.)  is  computed  in  the  Appendix, 

Section  2.7,  from  the  architecture  test  results.  ^The  total  main  memory  life  cycle 
cost  for  each  system  was  computed  as  described  in  paragraph  2. 3. 3. 3 and  is  shown 
in  Table  2-4b  for  l97b  and  1985  procurements.  The  unit  main  memory  life  cycle 
cost  for  each  system  is  shown  in  Table  2-4c.  The  average  unit  main  memory  life 
cycle  cost  in  197b  for  all  systems  and  all  architectures  is  $232,500.  The  costs 
using  the  PDP-11  and  8/32  architectures  are  13.911  and  12.7:t  below  the  average 
while  the  cost  using  the  IBM  S/37u  is  2b. b%  above  the  average. 
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Table  2-2 

System  Proponent  Data 


Sys. 

# 

System  Mission 

n. 

1 

Mr^ 

(MIPS) 

*PM. 

1 

*DM. 

1 

*PMa. 

1 

*DMa . 
1 

S.** 

1 

1 

Medium  Search 

192 

1.33 

.414 

.101 

1.9 

7.7 

32 

2 

Medium  Command  and  Control 

27 

.26 

1.638 

.412 

2.2 

8.8 

144 

3 

Small  Search 

100 

1.00 

.512 

.128 

2.8 

11.2 

20 

4 

Large  Command  and  Control 

178 

.20 

13.600 

3.400 

4.0 

16.0 

375 

b 

Medium  Conxnand  and  Control 

64 

.50 

1.600 

.400 

15.8 

63.2 

47 

6 

Large  Conmand  and  Control 

30 

.40 

3.321 

.820 

8.4 

33.6 

250 

7 

Small  Conmand  and  Control 

832 

.75 

.618 

.152 

.4 

1.6 

100 

d 

Large  Communications 

616 

.18 

3.200 

.800 

13.4 

52.0 

175 

9 

Small  Communications 

800 

.16 

.116 

.031 

0 

0 

8 

10 

Small  Communications 

9 

.53 

.408 

.102 

3.2 

12.8 

83 

11 

Small  Special  Purpose 

30 

.48 

.328 

.082 

.1 

.3 

14 

12 

Large  Data  Management 

16 

.02 

1.600 

.400 

573.4 

2293.6 

324 

13 

Medium  Search 

50 

.35 

3.712 

.928 

3.2 

12.8 

28 

14 

Medium  Data  Management 

8 

.80 

3.200 

.800  1912.0 

7648.0 

1 

lb 

Small  Guidance  and  Control 

3325 

.20 

.006 

.002 

0 

0 

1 

* P and  D are  fractions  applied  to  the  proponent's  stated  memory  requirements 
which  reflect  an  estimate  of  memory  used  for  programs  (P)  vs.  data  (0). 
Values  are  expressed  in  megabits. 


Table  2-3a 

Processor  Life  Cycle  Cost  Parameters 


System 

# 

System  Mission 

# Units 
n 

i 

Mr. 

1 

(MIPS) 

Processor  Speed 
Ratio,  a 

J 

INTERDATA  DEC  PDPll 

IBM  S370 

1 

ledium  Search 

192 

1.33 

0.81 

U.92 

1.28 

2 

ledium  Command  and  Control 

27 

.26 

0.81 

0.81 

1.39 

3 

Small  Search 

100 

1.00 

0.84 

0.78 

1.28 

4 

Large  Co'tTiiai’''  anc  Control 

178 

.20 

0.79 

0.78 

1.44 

5 

‘lediu;;  ComnanC  and  Control 

.50 

0.81 

0.78 

1.41 

6 

Large  Coiiman]  and  Control 

30 

.40 

0.79 

0.83 

1.38 

7 

jmall  ConTiano  ana  Control 

832 

.75 

0.77 

0.77 

1.47 

'6 

Large  Ccjnmuni cations 

61t> 

.18 

0.81 

0.75 

1.46 

9 

Small  Communications 

80U 

.16 

0.89 

0.83 

1.29 

10 

Small  Communications 

9 

.53 

0.87 

0.79 

1.35 

11 

Small  Special  Purpose 

30 

.48 

0.78 

0.73 

1.49 

12 

Large  Data  Management 

16 

.02 

0.80 

0.85 

1.36 

13 

ledium  Search 

50 

.35 

0.89 

0.83 

1.28 

14 

ledium  Data  Management 

8 

.80 

0.83 

0.77 

1.41 

lb 

.^aiiall  Guidance  and  Control 

3325 

.20 

0.80 

0.76 

1.42 

Table  2-3b 

Total  Processor  Life  Cycle  Cost  vs.  CFA  for  1976  and  198b  Procurements 

($  X 10^) 


Sys. 

» 

SYSTEM  MISSION 

1976  Procurement 
INTER- 
DATA DEC  IBM 

8/32  PDP-11  S370 

1985 

INTER- 

DATA 

8/32 

Procurement 

DEC  IBM 

PDP-11  S370 

1 

Medium  Search 

24,9 

26.2 

29.9 

2.49 

2.62 

2.99 

2 

tiedium  Command  and  Control 

1,8 

1.8 

2.3 

.18 

.18 

.23 

3 

Small  Search 

11.8 

11.4 

13.9 

1.18 

1.14 

1.39 

4 

Large  Command  and  Control 

10.7 

10.7 

13.6 

1.07 

1.07 

1.36 

5 

Medium  Command  and  Control 

5.6 

5.5 

7.0 

.56 

.55 

.70 

b 

Large  Command  and  Control 

2.4 

2.4 

3.0 

.24 

.24 

.30 

7 

Small  Command  and  Control 

84.2 

84.2 

109.0 

8.42 

8.42 

10.90 

8 

Large  Comnuni cations 

35.9 

34.8 

45.5 

3.59 

3.48 

4.55 

9 

Small  Communications 

46.2 

44.9 

53.6 

4.62 

4.49 

5.36 

lU 

Small  Communications 

.8 

.8 

1.0 

.08 

.08 

.10 

11 

Small  Special  Purpose 

2.6 

2.5 

3.3 

.26 

.25 

.33 

12 

Large  Data  Management 

,4 

.4 

.5 

,04 

.04 

.05 

13 

Medium  Search 

4.0 

3.8 

4.6 

.40 

.38 

.46 

14 

Medium  Data  Management 

.9 

.8 

1.0 

.09 

.08 

.10 

15 

Small  Guidance  and  Control 

201.3 

197.2 

253.2 

20.13 

19.72 

25.32 

16 


i ■ 11  I h nwy 


197o  and  1985  f'rocurements 


Table  2-4a 


Main  Memory  Life  Cycle  Cost  Parameters 


Sys. 

# 

System  Mission 

# Units 

n. 

1 

Program 

Memory 

PM.* 

1 

Data 
Memory 
DM  * 
i 

Static 

INTER 

DATA 

8/32 

Storage  Ratio, b. 

DEC  IBM 

PDP-11  S370 

1 

Medium  Search 

192 

.414 

.101 

0.84 

0.93 

1.21 

2 

Medium  Command  and  Control 

27 

1.638 

.412 

0.86 

0.85 

1.30 

3 

Small  Search 

100 

.512 

.128 

0.88 

0.83 

1.28 

4 

Large  Command  and  Control 

178 

13.600 

3.400 

0.81 

0.81 

1.38 

5 

Medium  Command  and  Control 

64 

1.600 

.400 

0.85 

0.82 

1.32 

6 

Large  Comnand  and  Control 

30 

3.321 

.830 

0.84 

0.84 

1.32 

7 

Small  Command  and  Control 

832 

.618 

.152 

0.81 

0.82 

1.37 

b 

Large  Communications 

616 

3.200 

.800 

0.84 

0.80 

1.37 

9 

Small  Communications 

800 

.116 

.031 

0.95 

0.86 

1.19 

10 

Small  Communications 

9 

.408 

.102 

0.90 

0.82 

1.29 

11 

Small  Special  Purpose 

30 

.328 

.082 

0.83 

0.78 

1.39 

12 

Large  Data  Management 

16 

1.600 

.400 

0.83 

0.85 

1.32 

13 

Medium  Search 

50 

3.712 

.928 

0.92 

0.88 

1.21 

14 

Medium  Data  Management 

8 

3.200 

.800 

.84 

0.79 

1.37 

15 

Small  Guidance  and  Control 

3325 

.006 

.002 

0.86 

0.82 

1.32 

* Values  in  megabits 


Table  2-4b 

Total  Main  Memory  Life  Cycle  Cost  vs.  CFA 
for 

1976  and  1985  Procurements 

($  X 10^) 


Sys. 

f 

SYSTEM  MISSION 

1976 

INTER- 

DATA 

8/32 

Procurement 

DEC  IBM 

PDP-11  S370 

1985 

INTER- 

DATA 

8/32 

Procurement 

DEC  IBM 

PDP-11  S370 

1 

Medium  Search 

6.89 

7.47 

9.44 

0.69 

0.75 

0.94 

2 

Medium  Command  and  Control 

3.93 

3.90 

5.49 

0.39 

0.39 

0.55 

3 

Small  Search 

4.63 

4.42 

6.27 

0.46 

0.44 

0.63 

4 

Large  Command  and  Control 

205.28 

205.28 

315.67 

20.53 

20.53 

31.57 

5 

Medium  Command  and  Control 

9.01 

8.77 

12.86 

0.90 

0.88 

1.29 

6 

Large  Commana  and  Control 

8.69 

8.69 

12.51 

0.87 

0.87 

1.25 

7 

Small  Command  and  Control 

43.44 

43.85 

66.47 

4.34 

4.39 

6.65 

8 

Large  Communications 

171.89 

165.58 

255.47 

17.19 

16.56 

25.55 

9 

Small  Communications 

9.04 

8.37 

10.82 

0.90 

0.84 

1.08 

10 

Small  Communications 

0.34 

0.31 

0.45 

0.03 

0.03 

0.46 

11 

Small  Special  Purpose 

2.62 

2.58 

3.06 

0.26 

0.2b 

0.31 

12 

Large  Data  Management 

2.21 

2.25 

3.22 

0.22 

0.26 

0.32 

13 

Medium  Search 

17.37 

16.78 

21.68 

1.74 

1.68 

2.17 

14 

Medium  Data  Management 

2.23 

2.13 

3.32 

0.22 

0.21 

0.33 

15 

Small  Guidance  and  Control 

1.90 

1.84 

2.64 

0.19 

0.18 

0.26 

."J 

f 


1o  Relative  to  Average (12.7)  (13.9) 2b. 6 


(4)  Secondary  Memory  Life  Cycle  Cost 


The  parametric  data  required  for  secondary  memory  life  cycle  cost  computa- 
tion is  Shown  in  Taole  2-5a.  The  total  secondary  memory  life  cycle  cost  for  each 
system  was  computed  as  described  in  paragraph  2. 3.3. 4 and  is  shown  in  Taole  2-5b. 

The  unit  secondary  memory  life  cycle  cost  for  each  system  is  shown  in  Table  2-5c. 

The  average  unit  secondary  memory  life  cycle  cost  for  all  systems  and  architectures 
in  iy7b  is  >3.4M.  The  costs  using  the  PDP-11  and  b/32  architectures  are  3.9%  and 
3.2%  below  tne  average  while  the  cost  using  the  IBM  S/370  is  7.2%  above  the  average. 

(5)  Total  Hardware  Life  Cycle  Cost 

Tables  2-3o,  2-4o  and  2-5b  are  summed  to  obtain  the  total  hardware  life  cycle 
cost  vs.  CFA  for  197b  and  l9bt)  procurements.  The  result  is  shown  in  Table  2-6a. 
Taole  2-oa  indicates  that  the  DEC  PDP-11  and  Interdata  a/32  architectures  provide 
significantly  lower  hardware  costs  than  the  IBM  S/370  architecture.  The  average 
hardware  life  cycle  cost  for  all  systems/arcnitectures  in  197d  is  S1.7bb.  The 
costs  using  POP-il  and  o/il  architectures  are  6.1%  and  7.7%  below  the  average 
wnile  tne  cost  using  the  S/370  architecture  is  lb. 4%  above  the  average  in  l97o. 

Tables  2-3c,  2-4c  and  ii-bc  are  summed  to  obtain  the  unit  hardware  life  cycle 
cost  vs.  CFA  for  19/o  and  196b  procurements  as  shown  in  Table  2-bb.  The  average 
unit  hardware  life  cycle  cost  for  all  systems/architectures  in  l97b  is  $3.7M. 

Tne  unit  costs  using  the  PDP-11  and  d/3<i  architectures  are  4.7%  and  3.9%  oelow 
tne  average  wnile  tne  cost  using  the  S/37u  is  a.b%  above  the  average  in  197b. 

(6)  Applications  Software  Life  Cycle  Cost 

To  determine  tne  applications  software  life  cycle  cost,  it  was  necessary  to 
derive  the  software  tool  availability  index  from  tne  report  of  the  Software 
Evaluation  rietnodology  SuDcommittee  LWagnJ  7oj  for  eacn  CFA  for  197b  and  196b; 
tnen,  to  compute  tne  cost  per  applications  software  instruction. 

As  a baseline  for  tne  computation  of  tne  applications  software  life  cycle 
cost  in  accordance  with  paragraph  2.3.3.b,  the  median  cost  curve  shown  in  Figure 
2-2  was  employed.  At  the  average  TAI  of  b2%,  this  curve  indicates  a cost  per 
instruction  of  $17,  for  197o.  Tne  cost  per  instruction  for  the  3 CFA  finalists 
in  197b  was  estimated  at  $24,  $16,  and  $12  for  Interdata  6/32,  DEC  PDP-11  and 
IBM  S/37U,  based  upon  TAI  values  of  34%,  bU%  and  73%,  respectively.  The  cor- 
responding values  for  l96b  were  computed  by  assuming  an  annual  expenditure  of 
$2M  to  augment  the  support  software  base  of  the  selected  CFA.  The  resulting 
TAI  values  in  196b  are  63%,  1DU%  and  lDu%  corresponding  to  cost  per  instruction 
of  $10,  $7. bo  and  $7.bO  for  Interdata  6/32  DEC  POP-il  and  IBM  S/37d,  respectively. 
This  data  was  then  employed  to  compute  applications  software  life  cycle  cost  for 
eacn  of  the  lb  systems  under  consideration,  for  each  CFA  and  for  1976  and  1965. 

Tne  resulting  life  cycle  costs  are  snown  in  Table  2-7  assuming  an  annual  support 
software  expenditure  of  $2M.  Tnis  table  indicates  that  the  average  applications 
software  life  cycle  cost  in  l97o  for  all  systems/architectures  is  $lb2M.  The 
cost  using  the  PDP-11  is  approximately  equal  to  tne  average  wnile  tne  costs 
using  6/32  ano  S/37u  are  33%  aoove  and  $3*  oelow  the  average  respectively  in 
197b. 

In  l96b,  tne  average  software  life  cycle  cost  is  reduced  to  $7bM.  The  cost 
using  the  PDP-11  ano  S/37u  are  9.7%  below  the  average  while  the  cost  using  the 
6/32  is  19%  aoove  tne  average  in  196b. 
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Table  2-5a 

Secondary  Memory  Life  Cycle  Cost  Parameters 


Sys. 

# 

SYSTEM  MISSION 

# Units 
n. 

1 

Program 

Memory 

PM  * 
i 

Data 
Memory 
DM  * 
i 

Static 

INTER 

DATA 

8/32 

Storage  Ratio, b^ 

DEC  IBM 

PDP-11  S370 

1 

'Odium  Search 

192 

1.9 

7.7 

0.84 

0.93 

1.24 

2 

ilediuin  Command  and  Control 

27 

2.2 

8.8 

0.86 

0.85 

1.30 

3 

Small  Search 

100 

2.8 

11.2 

0.88 

0.83 

1.28 

4 

Large  Command  and  Control 

178 

4.0 

16.0 

0.81 

0.81 

1.38 

5 

Medium  Command  and  Control 

64 

15.8 

63.2 

0.85 

0.82 

1.32 

6 

Large  Co.-iimand  and  Control 

30 

8.4 

33.6 

0.84 

0.84 

1.32 

7 

Small  Comnann  and  Control 

832 

.4 

1.6 

0.81 

0.82 

1.37 

8 

Large  Coinnuni cations 

616 

13.0 

52.0 

0.84 

0.80 

1.37 

9 

Small  Communications 

800 

0 

0 

0.95 

0.86 

1.19 

10 

Small  Communications 

9 

. 3.2 

12.8 

0.90 

0.82 

1.29 

11 

Small  Special  Purpose 

30 

.1 

.3 

0.83 

0.78 

1.39 

12 

Large  Data  Management 

16 

573.4 

2293.6 

0.83 

0.85 

1.32 

13 

Medium  Search 

50 

3.2 

12.8 

0.92 

0.88 

1.21 

14 

MoJium  Data  Management 

8 

1912.0 

7648.0 

0.84 

0.79 

1.37 

IS 

imall  Guidance  and  Control 

332b 

0 

0 

0.86 

0.82 

1.32 

1 * Values  in  megabits 

i 
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Table  2-5b 

Total  Secondary  Memory  Life  Cycle  Cost  vs.  CFA 

for 

1976  and  '98b  Procurements 
(S  X 10^) 


197b 

Procurement 

1985 

Procurement 

Sys. 

INTER- 

INTER- 

9 

SYSTEM  MISSION 

DATA 

OEC  IBM 

DATA 

OEC  IBM 

8/32 

PDP-11  S370 

8/32 

PDP-11  S370 

1 

•i*^  01  urn  Searcn 

7.14 

7.27 

7.72 

0.71 

0.73 

0.77 

2 

Medium  Command  and  Control 

1.15 

1.15 

1.26 

0.11 

0.11 

0.13 

3 

Small 

Search 

5.46 

5.41 

5.91 

0.85 

0.54 

0.59 

4 

Large  Ccifiiiano  and  Control 

13.70 

13.70 

. 15.32 

1.37 

1.37 

1.53 

j 

tedium  Comma. id  anu  Control 

19.61 

19.50 

21.82 

1.96 

1.95 

2.15 

b 

Larne 

Lv.i'inaro  .'no  Control 

4.88 

4.88 

5.86 

0.49 

0.49 

0.59 

7 

Small 

Command  and  Control 

b.4U 

6.41 

7.65 

0.64 

0.64 

0.76 

a 

Large 

Communicaticns 

155.03 

153.75 

172.01 

15.50 

15.37 

17.20 

9 

Small 

Communications 

0 

0 

0 

0 

0 

0 

lU 

Small 

Communications 

.bb 

.55 

.61 

0.06 

0.06 

0.06 

11 

. oil 

Special  Purpose 

.U4 

.04 

.05 

0 

0 

0 

12 

u . ''  ;e 

Data  Management 

177.26 

177.98 

195.23 

17.72 

17.80 

19.52 

13 

■iun  Search 

3.15 

3.12 

3.38 

0.31 

0.31 

0.34 

14 

iium  Lata  Management 

296.13 

293.07 

328.56 

29.61 

29.61 

32.86 

15 

Small 

Guidance  and  Control 

U 

0 

0 

0 

0 

0 

23 


Table  2-bc 

Unit  Secondary  Memory  Life  Cycle  Cost  vs.  CFA 
for 

1976  and  1985  Procurements 


Table  2-6a 


Total  Hardware  Life  Cycle  Cost  vs.  CFA 
for 

1976  and  1985  Procurements 

($  X 10^) 


f 

WfW 

Procurement 

1985 

Procurement  I 

Sys. 

INTER- 

INTER- 

# 

SYSTEM  MISSION 

DATA 

DEC 

IBM 

DATA 

DEC 

IBM 

8/32 

PDP-11 

S370 

8/32 

PDP-11 

S370 

> 

'1 

‘Ionium  Search 

38.9 

40.9 

47.1 

3.9 

4.1 

4.7 

1 2 

lleduim  Command  and  Control 

6.9 

6.9 

9.1 

0.7 

0.7 

0.9  ; 

1 

3 

Small  Search 

21.9 

21.2 

26.1 

2.2 

2.1 

1, 

2.6  j 

[ 

Large  Command  and  Control 

229.7 

229.7 

344.60 

23.0 

23.0 

34.5  1 

iS 

\ ^ 

Medium  Command  and  Control 

34.2 

33.8 

41.4 

3.4 

3.4 

4.1  ^ 

\\ 

2 6 

Large  Command  and  Control 

Ib.O 

16.0 

21.4 

1.6 

1.6 

2.1  1 

i '/ 

Small  Command  and  Control 

134.0 

134.5 

183.1 

13.4 

13.4 

18.3  ,] 

1 ' 

i 

Large  Communications 

362.8 

354.1 

473.0 

36.3 

35.4 

47.3 

Small  Coiimuni cations 

55.2 

53.3 

64.4 

5.5 

5.3 

6.4 

\ lu 

; 

Small  Communications 

1.7 

1.7 

2.1 

.2 

.2 

.2 

[ 11 

Small  Special  Purpose 

5.3 

5.1 

6.4 

.5 

.5 

.6 

12 

Large  Data  Management 

179.9 

180. 0 

199.0 

18.0 

18.1 

19.9 

13 

Medium  Search 

24.5 

23.7 

29.7 

2.4 

2.4 

3.0 

14 

t- 

i'eoium  Data  Management 

299.3 

296.0 

332.9 

29.9 

29.6 

33.3 

15 

Small  Guidance  and  Control 

2U3.2 

199.0 

255.8 

20.3 

19.9 

25.6  ' 

Total  Cost 

1614 

1597 

2036  161.3  159.7 

203.5 

% Relative  to  Average 

(7.7) 

(8.7) 

16.4 

Table  2-bb 

Unit  Hardware  Life  Cycle  Cost  vs.  CFA 
for 

1976  and  1985  Procurements 


Table  2-7 


I 


( 


1 


r 


Applications  Software  Life  Cycle  Cost  vs.  CFA 
Assuming  Software  Tool  Expenditure  of  $2M/Yr 

($  X 10^) 


SYS. 

# 

SYSTEM  MISSION 

1976 

INTER- 

DATA 

HI21 

Procurement 

DEC  IBM 

PDP-11  S370 

1985 

INTER- 

DATA 

8/32 

Procurement 

DEC  IBM 

PDP-11  S370 

1 

l;*^(liurn  Search 

4.22 

3.17 

2.11 

I.7d 

1.32 

1.32 

2 

'lo-.liuni  Command  and  Control 

19.01 

14.26 

9.50 

7.92 

5.94 

5.94 

3 

S„iall  Search 

2.o4 

1.96 

1.32 

1.10 

.83 

.83 

4 

Large  Command  and  Control 

49.50 

37.13 

24.75 

20.63 

15.47 

15.47 

b 

Medium  Command  ana  Control 

6.20 

4.65 

3.10 

2.59 

1.94 

1.94 

0 

Large  Command  ana  Control 

33.00 

24.75 

16.50 

13.75 

10.31 

10.31 

7 

Snail  Conmarid  anc  Control 

13.20 

9.90 

6.60 

5.50 

4.13 

4.13 

a 

Large  communications 

23.10 

17.33 

11.55 

9.63 

7.33 

7.22 

b 

Small  Communications 

1.06 

.79 

.53 

.44 

.33 

.33 

10 

Small  Coi.ihiuni cations 

10.96 

8.22 

5.48 

4.57 

3.42 

3.42 

11 

Small  Special  Purpose 

1.85 

1.39 

.92 

.77 

.58 

.58 

12 

Large  Data  Management 

^z.n 

32.08 

21.38 

17.82 

13.37 

13.37 

13 

Medium  Search 

3.70 

2.77 

1.85 

1.54 

1.16 

1.16 

14 

::odium  Data  Management 

4.62 

3.47 

2.31 

1.92 

1.44 

1.44 

15 

S.  all  Guidance  and  Control 

.13 

.10 

.07 

.06 

.04 

.04 

Total  Cost 

216 

162 

108 

90 

68 

68 

% Relative  to  Average 

33 

- 

(33) 

19 

(9.7) 

(9.7) 

27 


r 

r 

(7)  Total  Life  Cycle  Cost  vs.  CFA 

Taole  2-oa  displays,  in  a single  chart,  the  comparison  of  total  life  cycle 
costs  for  each  of  the  three  architectures  for  1^76.  TaDle  il-bo  presents  the 
same  information  for  lyab.  Circled  values  indicate  the  least  cost  architecture 
for  a particular  system  and  tne  least  total  cost  for  implementing  all  fifteen 
systems.  Tne  numoer  of  times  an  architecture  is  thus  selected  is  also  totaled 
and  Shown  at  the  oottom  of  the  chart  as  the  Number  of  System  Preferences.  Table 
i-tidi  indicates  that; 

(a.)  In  ly76,  tne  DEC  PUP-11,  IdM  S/S70  and  Interoata  6/32  would 
nave  been  selected  for  11,  3 and  1 systems,  respectively,  on 
a life  cycle  cost  oasis.  Tne  average  total  life  cycle  cost 
for  all  systems/architectures  in  iy7o  is  Sl.ylB.  Tne  PDP-11 
and  6/32  costs  are  comparaole  being  6.0*  and  4.2*,  respectively 
below  the  average.  The  S/370  cost  is  12. 2^  above  the  average 
or  20.2*  above  tne  PDP-li  cost. 

( 0.)  In  iy6s,  (Taole  2-6b)  tne  system  preferences  for  DEC,  IBM 
and  Interdata  would  be  14. b,  O.b  and  none,  respectively. 

The  average  total  life  cycle  cost  for  all  systems/architec- 
tures is  S2bOM  in  lyos.  The  6/32  cost  is  approximately 
equal  to  the  average  cost  while  tne  PDP-ll  and  S/37U  costs 
are  6.y*  oelow  and  6.7*  above,  respectively,  the  average 
cost. 

(8)  Sensitivity  Analysis 

The  results  shown  in  Tables  2-6a  and  2-6b  are  based  upon  the  following 
parametric  values; 

(a.)  Cost  per  Instruction.  The  use  of  tne  median  curve  in 

Figure  2-2  for  estimating  the  cost  per  applications  soft- 
ware instruction  as  a function  of  TAI.  This  curve  yields 
an  average  cost  per  instruction  of  $17  in  ly7b  for  the 
three  CFA  finalists.  This  value  corresponds  to  an  average 
hardware; software  life  cycle  cost  ratio  of  12;1  and  2.4;1 
in  ly7b  and  iy6b,  respectively,  as  snown  in  Table  2-9. 

( 0.)  Support  Software  Investment  Rate.  The  data  presented 

thus  far  reflects  the  use  of  $2M  per  year  to  augment  the 
support  software  base.  Table  2-lU  indicates  the  impact 
of  alternate  investment  rates  of  $1M  and  $3M  annually 
upon  the  1966  cost  per  instruction. 

( cj  ►leighted  S,  M ana  R Values.  Tne  architecture  measures  of 
effectiveness  (S,  M and  R)  are  weighted  for  each  system 
application  as  described  in  the  Appendix,  Section  2.7. 

The  above  parametric  values  were  perturbed  in  order  to  determine  the  sensi- 
tivity of  tne  life  cycle  cost  model.  The  results  are  described  in  the  following 
subparagraphs. 


28 


(9)  Instruction  Cost  Sensitivity 


\ 


Tne  average  cost  per  instruction  in  1976  was  doubled  to  $d4,  or  $9  in  excess 
of  tne  worst-case  curve  in  Figure  2-1.  The  resulting  hardware; software  ratios 
are  b;l  and  1.2:1  in  197o  and  19ab  respectively,  as  shown  in  Table  2-9.  The 
resulting  life  cycle  costs  for  1976  and  198b  are  depicted  in  Tables  2-lla  and 
2-llb,  respectively.  These  tables  indicate  that  in  terms  of  the  comparative  costs 
of  the  three  architectures,  the  model  is  relatively  insensitive  to  doubling  the 
cost  per  applications  software  instruction.  Comparing  Tables  2-8a  and  2-lla,  IBM 
is  snown  to  picx  up  one  system  implementation  at  both  DEC  and  Interdata  expense  in 
l97b  so  that  DEC,  IBM  and  Interdata  architectures  would  be  preferred  in  lu.b,  4.0 
and  o.b  systems,  respectively.  The  DEC  architecture  remains  the  lowest  in  total 
life  cycle  cost  for  all  systems.  For  i98b,  comparing  Tables  2-8b  and  2-llb  shows 
hO  change  with  DEC  architecture  being  preferred  in  14. d systems. 

(10)  Support-Software  Investment-Rate  Sensitivity 

Tne  data  examined  thus  far  for  1985  reflect  an  investment  in  the  software 
bases  of  the  three  architectures  of  $2M  annually. 

The  data  for  19Bb  were  re-examined  to  determine  the  impact  of  reducing  the 
investment  in  the  software  base  to  $1M  annually  for  two  different  situations, 
i.e.,  for  tne  basic  cost  per  instruction  of  application  software  and  then  double 
the  basic  cost.  The  oata  are  summarized  in  Tables  2-12a  and  2-12b,  respectively. 
Table  2-12a  shows  that  the  selection  of  IBM  would  increase  to  b systems  while 
DEC  would  drop  to  ID.  This  is  also  predictable  since  at  a $1M  per  year  invest- 
ment rate  in  the  software  base  IBM  retains  for  a longer  time  its  cost  advantage 
in  producing  application  software.  At  this  lower  investment  rate.  Table  2-lU 
snows  that  while  IBM  has  achieved  the  ideal  support  software  set,  DEC  has  only 
oj%  while  Interdata  has  bTi. 

Doubling  the  cost  per  application  software  instruction  merely  extends  a 
software  favorable  situation  as  snown  in  Table  2-12d.  In  this  table,  IBM  selec- 
tions equal  uEC  selections  at  seven. 

(11)  Sensitivity  to  Unweighted  S,  M,  and  R Values 

The  data  presented  in  the  report  uses  weighted  values  of  the  S,  M,  and  R 
data  resulting  from  test  program  runs  and  provided  by  Carnegie  Mellon  University. 
The  weights  and  the  calculations  are  discussed  in  some  detail  in  the  Appendix, 
Section  2.7. 

Tne  data  was  re-examined  to  determine  the  impact  if  the  S,  M,  and  R measures 
were  used  without  the  discriminating  weights  applied.  The  results  are  displayed 
in  Table  2-i3  and  show  that,  for  198b,  the  model  is  relatively  insensitive  to  the 
weighting  factors  applied  to  the  S,  M,  and  R values.  At  $17  per  application  soft- 
ware instruction  a few  systems  shift  from  DEC  to  Interdata;  at  $34  per  instruction 
a few  systems  shift  from  DEC  to  IBM.  UEC  remains  predominant.  However,  for  1975, 
the  Interdata  gains  the  low-cost  position  for  unweighted  S,  M,  & R. 


(12)Summary  of  Perturbations 

In  subparagraphs  2. ‘♦.9  to  2.4.11,  we  have  re-examined  the  bottom  up  model 
to  determine  its  sensitivity  to  several  key  parameters.  The  results  are  sum- 
marized in  Table  2-14  which  shows  the  impact  on  the  number  of  times  an  architec- 
ture would  be  selected  to  implement  the  fifteen  Army  systems  for  each  of  the 
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stem  Preferences  1.0  11  3.U 


1976  Procurement 


# System  Preferences  - 14. b O.b 


t’rocureinent  and  Software  Tool  Fxpenditure  of  ii^ri/yr 


Table  2-9 

Hardware: Software  Ratios 
BOTTOM-UP  LIFE  CYCLE  COST  MODEL 


1976  AVG  APPL'N  SW  COST  = $17/1 
1976  PROC.  19B5  PROC. 


1976  AVG  APPL'N  SW  COST  = $34/1 
1976  PROC.  1985  PROC. 


EC 

P-11 

9.8 

2. 

t 

IBM 

S3  70 

18.9 

3.0 

9. 

4 1.5 

AVERAGE 

12 

2.4 

6. 

0 

1.2 

; 

Table  2-10 

Application  Software  Cost  Per  Instruction 
vs 

Support  Software  Investment  Rate 

A.  Software  Tool 

Availability  Index 

Annual  Support 
Software  Invest- 
ment SM 

INTERDATA 

8/32 

INTEROAT A 
8/32 

R85 

DEC 

PDP-11 

IBM  ’ 

S370 

1 

.34 

.50  .73 

0.61 

0.83 

1.0 

2 

.34 

.50  .73 

0.83 

1.0 

1.0 

3 

.34 

.50  .73 

1.0 

1.0 

1.0 

B.  Applications  Software  Cost  Per  Instruction  ($) 


# System  Preferences 0.5  10. b 


197fe  AVERAGE  APPL  SM  COST  = $34/INSTRUCTI0N 

SYSTEM  MISSION  n.  IHTERDATA  8/32  DEC  PDP-11  IBM  S370 


Total  Life  Cycle  Cost  vs  CFA 


1965  Procurement  and  Software  Tool  Expenditure  of  $lM/yr 


stem  Preferences 


19Kb  Procurement  and  Software  Tool  Expenditure  of  SlH/yr 


TABLE  2-14 

Summary:  Architecture  Selection 
vs 

Cost  Model  Parameters 


Case 

No. 

ARCHITECTURE 

PROCUREMENT 

YEAR 

ANNUAL  SW  BASE 
INVESTMENT 

AVG.  COST  PER 
INSTR.  ASW 

iUM 

DEC 

I NT 

1976  1985 

$1M  $2M  $3M 

S15 

$30 

Unweighted 

S.  M.  R 

1 

J 

11 

1 

X 

X 

2 

U.S 

14.5 

0 

X 

X 

X 

3 

'1 

1U.5 

0.5 

X 

X 

4 

0.5 

14.5 

0 

X 

X 

X 

5 

5 

10 

U 

X 

X 

X 

6 

/ 

7 

1 

X 

X 

X 

1 

U.3 

8.3 

biy 

X 

X 

— X 

8 

u 

11 

4 

X 

X 

X 

X 

9 

2 

13 

!J 

X 

X 

X 

X 

TABLE  2-13 

Total  Life  Cycle  Cost  vs  CFA 
Unweighted  Values  of  S,  M,  R 

{$  X 10^) 


X 


INTERDATA 


DEC 


$17/1  $34/1 


$17/1  $34/1 


TOTAL 
1985  COST 
$2M/YR 


251 


# SYSTEM  4 
PREFERENCES 


341 


242 


310 


11 


13 


37 


IBM 


$17/1  $34/1 


259 


327 


iBNiiteiii 


perturbations.  The  results  show  DEC  to  be  the  architecture  selected  predomi- 
nantly over  the  others. 

e.  SUMMARY/CONCLUSION 

(1)  Summary 

The  results  of  the  analysis  described  herein  are  summarized  in  Figure  2-2 
for  the  baseline  conditions  or  parameters,  namely,  an  average  applications  soft- 
ware cost  per  instruction  of  $17  in  197b  and  a support  software  investment  rate 
of  $2M  annually*  for  the  selected  CFA  to  19«6.  Figure  2-2  indicates  tnat; 

(a)  The  average  total  life  cycle  cost  for  all  15  systems  is 
estimated  at  51.91B  in  l97b  and  $2bUM  in  1985.  The  average 
hardware: software  ratio  decreases  from  12:1  in  l97b  to  2.4:1 
in  198b. 

(b)  In  1976,  the  number  of  systems  selecting  the  PUP-11  architecture 
on  the  basis  of  life  cycle  cost  is  the  largest  (11).  The  POP-11 
architecture  provides  the  lowest  total  life  cycle  cost  (8.Ui, 
below  the  average  cost)  by  a small  margin  (3.7%)  over  the  8/32 
architecture  and  by  a larger  margin  (2U.U%)  over  the  S/370 
architecture. 

(c)  In  1985,  tne  number  of  systems  selecting  the  PDP-11  architecture 
continues  to  provide  tne  lowest  total  life  cycle  cost  for  all 

15  systems  oy  margins  of  8.8%  and  17.6*  over  the  8/32  and  S/37U 
arcnitectures. 

Other  baseline  conditions  applicable  to  the  results  shown  in  Figure  2-2 
are:  (1)  hardware  cost  reduction  12:1  from  197b  to  198b;  (2)  hardware  life 
cycle  cost  is  twice  the  acquisition  cost;  and  (3)  software  life  cycle  cost 
is  b.b  times  the  acquisition  cost. 

The  results  shown  in  Figure  2-2  are  not  significantly  changed  if  the 
average  applications  software  cost  per  instruction  in  197b  is  doubled  to  $34 
(tnereby  decreasing  the  hardware: software  ratio  oy  a factor  of  2)  or  if  the 
annual  support  software  investment  for  tne  selected  CFA  is  increased  to  $3m 
or  decreased  to  $1M. 

(2)  Conclusion 

The  results  obtained  witn  the  bottom-up  life-cycle  cost  model  show  that  the 
DEC  PDP-11  architecture  would  provide  the  lowest  life  cycle  cost  for  most  of  the 
lb  Army  embedded-computer  systems  considered  and  for  the  lb  systems  as  an  entity 
in  1976  and  1985  under  the  following  conditions: 

(aj  Applications  software  cost  per  instruction  of  $17  and  $34 
in  1976.  Lower  costs  are  assumed  in  1985  as  the  support 
software  base  is  augmented.  * 


‘Editor's  Note:  M denotes  millions  of  dollars 
u denotes  billions  of  dollars 


A.  AVERAGE  TOTAL  LIFE  CYCLE  COSTS  ($auu.UOO) 


Type  Cost 

197t> 

1985 

Hardware 

$1750 

$175 

Software 

162 

75 

TOTAL 

$1912 

$250 

HUW/SW  Ratios* 

12:1 

2.4:1 

iV7o  ARCHITECTURE  COMPAR I SON 


f System  Relative  Total  Cost** 


Aren i tec tu re 

Preferences 

HOW 

SW 

Total 

tt/82 

1 

.92 

1.88 

.96 

KOP-il 

11 

.91 

1.00 

.92 

S/870 

8 

1.16 

.67 

1.12 

ia»6  architecture  I 

COMPARISON 

Architecture 

# System 

Relative  Total 

Cost** 

Preferences 

HOW 

SW 

Total 

0/82 

- 

.92 

1.20 

1.00 

ROP-11 

14.5 

.91 

.91 

.91 

S/8/u 

0.5 

1.16 

.91 

1.09 

Hardware/software  ratios  are  calculated  from  cost  data  detailed  in  Table  2-8 
l.ou  denotes  average  cost 


Figure  2-2.  Summary;  Bottom  Up  Life  Cycle  Cost  Analysis 


»•  Support  software  investment  rate  of  $1M,  $2M  and  per 
year  to  lyob. 

f c.  Architecture  test  measures  of  effectiveness  (S,  M and  R) 

f are  weighted  for  each  system  application. 

1 

I d.  Haroware  cost  reduction  of  1U;I  from  1976  to  19bb. 


> e.  Hardware  life  cycle  cost  is  twice  acquisition  cost,  soft- 

I ware  life  cycle  cost  is  5.6  times  acquisition  cost. 

I 

I 

I 
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a,  APPENDIX  A - Computation  of  Processor  Speed  and  Static  Storage  Ratios 
(1)  Introduction 

This  appendix  describes  the  procedure  used  to  compute  the  processor  speed 
ratio  and  tne  static  storage  ratio  b- ■. 

I J I J 

(?)  Definition  of  Terms 

Tne  arcnitecture  test  program  has  defined  three  terms  (S.,  M.,  and  R-) 
to  measure  the  effectiveness  of  architecture  j.  J J J 

S is  a measure  of  the  amount  of  memory  needed  to  represent  a particular 
test  program  on  the  jth  architecture. 

1*1.  is  a measure  of  tne  processor/memory  transfers  required  to  execute  a 
particular  test  program  of  the  jth  architecture,  i.e.,  the  number  of  a bit  bytes 
that  must  oe  read  or  written  oy  tne  processor! s)  in  primary  memory, 

R.  IS  a measure  of  the  internal  regi ster-to-regi ster  transfers  required  by 
the  processor  to  execute  a particular  test  program  on  the  jth  arcnitecture, 

a.,  and  b^-  are  factors  which  act  as  penalties  or  bonuses  when  applied  to  the 
cost  mooel.  Tiie  degree  of  penalty  or  bonus  is  determined  by  evaluating  the  results 
of  running  the  test  programs  in  terms  of  S,  M,  and  R and  calculating  a^  • and  b. . as 
shown  in  this  appendix.  ^ ^ 

(3)  Architecture  Test  Results 

Twelve  test  programs  listed  in  Table  i-A.l,  each  emphasizing  a particular 
type  of  processing,  were  run  on  the  candidate  architectures.  S,  K,  and  R data 
were  collected  oy  S,  Fuller  at  Carnegie  mellon  University.  For  the  purposes  of 
this  report  the  multiple  values  of  S,  M,  ano  R were  averaged  and  placed  into  a 
12  by  y matrix.  Eacn  row  depicts  one  of  the  twelve  test  routines  and  tne  nine 
columns  are  comprised  of  an  S,  M,  ano  R measure  for  each  of  the  three  architectures. 

(4)  Computation 

A second  matrix,  12  oy  lb,  was  developed  where  again  each  row  depicts  one 
of  the  twelve  test  routines  and  eacn  of  tne  fifteen  columns  represents  a prior 
generation  military  computer  (R(jMC).  Each  element  in  the  m x n matrix  consisted 
of  a weight  (Wmn)  which  was  subjectively  assigned  as  a measure  of  the  relevance 
of  test  program  m to  RGUC  n.  Weight  assignment  was  such  that  any  column  (system 
weight  set)  summed  to  unity  (Table  2-A.2). 

The  twelve  test  routines,  listed  in  Table  <!-A.l  were  considered  to  fall  into 
one  of  two  categories: 

1.  Test  programs  I,  2,  and  3 relate  principally  to  I/O  functions. 

2.  The  remaining  programs  (A-12)  are  associated  with  traditional 
processor/memory  functions. 

Witnip  tnese  two  subsets,  varying  degrees  of  functional  overlap  occur  among 
the  test  routines. 


Table  ^-A.l 


\ 


h 

i 


Architecture  Test  Programs 

1.  I/O  Kernel,  Four  Priority  Levels 
d.  I/u  Kernel,  FIFO  Processing 

3.  I/O  Device  Handler 

4.  Large  FFT 

b.  Character  Search 
b.  Bit  Test,  Set,  or  Reset 
/.  Runge  Kutta  Integration 
B.  Linked  List  Insertion 
!#.  Ouick  Sort 

10.  ASC  II  to  Floating  Point  Conversion  Routine 

11.  Boolean  Matrix  Transpose 

li;.  Virtual  Memory  Space  Excnange 


Tne  first  weighting  step  consisted  of  assigning  gross  values  to  categories 
1 and  2 for  each  system.  Subsequently,  each  initially  assigned  value  was  dis- 
triouted  across  the  test  routines  within  the  associated  category. 


Table  2-A.2 

Weights  Assigned  To  Each  System  To  Emphasize  or 
i)e-Eniphasize  The  Relative  Importance  Of 
The  Test  Program  To  The  System 


SYSTEM 

TEST 

PROGRAM 

f 

A 

6 

C 

0 

E 

F 

G 

H 

I 

0 

K 

L 

1 

.lb 

.Ob 

.20 

.10 

.lb 

.05 

.05 

0 

.10 

.05 

.05 

.05 

2 

.lb 

.Ob 

.lb 

0 

.20 

.05 

.25 

0 

.05 

0 

.Ob 

.05 

3 

.lb 

.Ob 

.lb 

0 

.3b 

.Ob 

.10 

0 

.05 

0 

.05 

.05 

4 

.20 

.Ob 

.20 

0 

.20 

.Ob 

.15 

0 

.05 

0 

.Ob 

.05 

b 

.lb 

.10 

.lb 

0 

.30 

.05 

.10 

0 

.Ob 

0 

.Ob 

.05 

b 

.2u 

.05 

.lb 

0 

.2b 

.Ob 

.05 

.Ob 

.10 

0 

0 

.10 

7 

.20 

.Ob 

.20 

0 

.lb 

.Ob 

.30 

0 

.05 

0 

0 

0 

6 

.20 

.Ob 

.20 

0 

.2b 

.10 

.05 

.10 

.05 

0 

0 

0 

y 

.Ob 

.lb 

.30 

0 

.35 

.05 

.05 

0 

.05 

0 

0 

0 

:u 

.lb 

.Ob 

.40 

0 

.2b 

.05 

.05 

0 

.05 

0 

0 

0 

11 

.20 

.10 

.10 

0 

.3b 

.05 

.10 

0 

.05 

0 

0 

.05 

12 

.20 

.Ob 

.20 

0 

.20 

0 

.05 

.10 

.10 

0 

0 

.10 

13 

.10 

.Ob 

.20 

.Ob 

.30 

.Ob 

.10 

0 

.05 

.05 

0 

.05 

14 

.20 

.Ob 

.35 

0 

.20 

.05 

.05 

0 

.05 

0 

0 

.05 

lb 

.10 

.10 

.lb 

0 

.Ob 

.20 

.40 

0 

0 

0 

0 

0 

For  example,  the  Combat  Service  Support  System  (CS3)  resembles  contemporary 
commercial  data  processing  in  its  use  of  COBOL  and  data  bases.  Thus,  its  weighting 
was  positively  biased  toward  I/O  and  processing  routines  such  as  "Linked  List  In- 
sertion," and  negatively  biased  with  regard  to  mathematical  oriented  routines 
such  as  "Runge  Kutta".  On  the  other  hand,  the  Tank  Ballistics  Application  Computer 
System  will  oe  used  primarily  to  perform  trajectory  computations  - its  weighting 
favored  "Runge  Kutta"  but  was  biased  against  "Linked  List  Insertion." 

The  values  of  S,  M,  and  R in  the  IZ  x '4  matrix  then  are  normalized  by  row 
and  multiplied,  element  by  element,  by  the  12  x 15  matrix  of  test  program  weights. 

^3,2  '^13  ^2S  hz  * '^33  ^yz  ^ * ^12,3 

Similarly,  for  system  3,  values  of  S were  found  for  the  first  and  third 
architectures,  i.e.,  S.  , and  S.  An  average  S was  then  calculated  for 
system  J. 

S.  = ^3.1  ^ ^3.2  ^3.3 

^ 3 

The  value  of  b for  system  3 in  architecture  2 was  found  by  solving  for: 

- ^3,2 


In  this  manner,  a value  of  b for  each  system  in  each  architecture  (15x3) 
was  calculated.  These  results  are  shown  in  Table  2-A.3. 

The  ratio  a.,  was  determined  from  the  general  relationship 

3S1mw  + ^ RW 

a = 

3 M + R 

Tne  actual  procedure  of  multiplying  corresponding  elements  of  the  two 
matrices  is  identical  to  that  used  in  the  solution  of  the  ratio  b.  and  will 
not  be  repeated  nere.  As  in  b.,  a value  of  a was  calculated  for  each  sys- 
tetn  in  each  architecture.  The'^ results  are  snown  in  Table  2-A.3. 


Table  2-A.3 

Static  Storage  Ratio  and  Processor 
Speed  Ratios  for  Each  Architecture 


SYSTEM  MISSION PROCESSOR  SPEED  STATIC  STORAGE 

RATIO,  a.  . RATIO,  b.. . 

INTER-  ^ INTER-  ^ 


DATA 

8/32 

DEC 

PDP-11 

IBM 

S370 

DATA 

8/32 

DEC 

PDP-11 

IBM 

S370 

1 

Medium  Search 

U.dl 

0.92 

1.28 

0.84 

0.93 

1.24 

i 

Medium  Command  and  Control 

O.dl 

0.81 

1.39 

0.86 

0.8b 

1.30 

i 

Small  Search 

0.84 

0.78 

1.28 

0.88 

0.83 

1.28 

4 

Large  Command  and  Control 

0.79 

0.78 

1.44 

0.81 

0.81 

1.38 

b 

Medium  Command  and  Control 

0.81 

0.78 

1.41 

0.85 

0.82 

1.32 

6 

Large  Coinnand  and  Control 

0.79 

0.83 

1.38 

0.84 

0.84 

1.32 

7 

Small  Command  and  Control 

0.77 

0.77 

1.47 

0.81 

0.82 

1.37 

6 

Large  Communications 

0.81 

0.75 

1.46 

0.84 

0.80 

1.37 

a 

Small  Coniiiunicati ons 

0.89 

0.83 

1.29 

0.95 

0.80 

1.19 

lu 

Small  Cofflmunications 

0.87 

0.79 

1.35 

0.90 

0.82 

1.29 

11 

Small  Special  Purpose 

0.78 

0.73 

1.49 

0.83 

U.76 

1.39 

u 

Large  Uata  Management 

0.80 

0.85 

1.36 

0.83 

0.8b 

1.32 

Medium  Search 

0.89 

0.83 

1.28 

U.92 

0.88 

1.21 

14 

Medium  Uata  Management 

0.83 

0.77 

1.41 

0.84 

0.79 

1.37 

; lb 

Small  Guidance  and  Control 

0.80 

0.7b 

1.42 

0.86 

0.82 

1.32 
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3.  THE  TOP-DOWN  MODEL 
a.  INTRODUCTION 

This  paper  descrioes  the  mathematical  formulation,  parameter  sensitivity, 
and  error  analysis  of  a life-cycle  cost  model  for  comparing  computer  architec- 
tures. The  model  quantitatively  compares  computer  architectures  by  projecting 
trends  and  combining  estimates  of  architecture-dependent  hardware  and  software 
costs  to  obtain  discounted  life-cycle  costs  and  cost  ratios. 

The  model  was  developed  in  order  to  help  the  Army  and  Navy  determine  the 
most  cost  effective  of  three  candidate  computer  architectures,  with  the  intent 
tnat  this  architecture  would  be  the  basis  of  a software  compatible  family  of 
military  computers  over  the  197b-ly9U  time  period  LEsteR76],  The  three  candi- 
date architectures  were  the  131*1  S/37U,  the  Digital  Equipment  Corporation  PDP- 
il,  ana  trie  Interaata  6/3ii.  In  addition  to  descrioing  the  model,  this  paper 
gives  the  input  data  and  the  results  of  comparing  these  architectures. 

3y  selectively  perturbing  the  expected  values  of  key  parameters  and  ob- 
serving tne  effects,  we  were  aole  to  determine  tne  sensitivity  of  the  model  to 
uncertainties  in  the  input  data  and  to  determine  the  relative  importance  of 
each  piece  of  input  data.  In  comparing  the  lUM  S/37U,  tne  Digital  Equipment 
Corporation  PDP-li,  ana  tne  Interdata  6/6’i  computer  architectures  over  the 
197b-199U  time  frame,  tne  model  indicated  that  the  relative  cost  effectiveness 
of  these  architectures  was  most  sensitive  to  the  software- to-hardware  ratio  of 
the  computing  environment  and  to  the  support-software  base  available  for  each 
archi tecture. 

The  ma3or  findings  were  that  for  support-software  base  of  about  2 million 
dollars  per  year,  tne  I3M  S/37o  architecture  was  the  most  cost  effective  for 
software-to-hardware  (S/H)  greater  tnan  aoout  one,  while  for  S/H  ratios  less 
than  about  one  fourtn  tne  Interdata  d/32  was  superior.  For  intermediate  values 
of  S/H  the  DEC  PuP-11  was  superior.  These  findings  must,  however,  be  viewed  in 
light  of  tne  fact  that  error  analysis  shows  the  uncertainty  on  the  cost  ratios  to 
be  large  compared  to  the  cost  ratio  differences  among  the  architectures. 

before  describing  tne  model,  it  may  be  helpful  to  clarify  what  we  mean  by 
"computer  architecture."  Although  many,  often  conflicting,  definitions  of  this 
term  appear  in  the  literature,  the  joint  Arrny/Navy  Computer  Family  Architecture 
(CFA)  Selection  Committee  LSmitW7b,  ColeA/b,  SaliA7b]  has  defined  it  to  be  the 
abstract  view  of  a computer  as  seen  oy  an  assembly  language  programmer.  This 
view  includes  the  instruction  and  register  sets,  interrupt  structure,  and  memory 
addressing  scheme;  it  excludes  hardware  attributes,  such  as  cycle  time,  micro- 
programmed vs  hardwired  logic  implementations,  instruction  look-ahead  schemes, 
memory  interleaving  and  cacne  memories,  that  are  normally  transparent  to  the 
assembly  language  programmer.  A more  precise  statement  of  the  Selection  Commit- 
tee's definition  appears  in  Volume  1 of  this  set  of  reports. 

The  Uarbage-In-liarbage-Out  ((jlUO)  principle  applies  to  cost  models.  Cost 
models  often  require  as  input  estimates  of,  among  other  things:  initial  invest- 
ments, service  lives,  salvage  values,  operating  costs,  and  the  cost  of  money. 
Given  tnat  most  of  these  involve  a forecast  of  the  future,  their  preparation  is 
a difficult  task.  Although  we  can  be  guided  oy  our  own  past  experiences,  the 
experiences  of  others,  the  opinions  of  qualified  personnel,  and  the  results  of 
pilot  studies,  a degree  of  uncertainty  is  always  present.  This  uncertainty  does 
not,  however,  mean  that  it  is  fruitless  to  adhere  to  quantitative  analytical 
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techniques  because  the  alternative  leads  to  decisions  based  solely  on  judgment 
and  intuition  and  having  a probability  of  error  higher  than  that  of  the  quantita- 
tive approach.  A quantitative  approach  compels  the  involved  individuals  to  state 
their  estimates  explicitly  and,  unlike  the  qualitative  approach,  assures  that  these 
oata  can  oe  subjected  to  critique  and  analyzed  in  a rational  manner. 

Tne  decision  making  process  usually  involves  the  following  four  steps: 

Step  1)  Define  the  Alternatives 
Step  d)  Describe  the  Alternatives 
Step  i)  Evaluate  the  Alternatives 
Step  4)  Consider  tne  Irreducioles 

For  the  CFA  project,  the  first  step,  define  the  alternatives,  had  already 
been  carried  out  by  the  Selection  Committee  before  work  on  the  cost  model 
desribed  below  oegan.  The  identified  alternatives  were  to  standardize  on 
ei  ther- 

1)  the  IBM  S/S7U  architecture, 

li)  the  Digital  Equipment  Corporation  (DEC)  PDP-11  architecture,  or 
3)  the  Interdata  ti/6Z  architecture 

Restricting  the  life-cycle  cost  comparisons  to  these  architectural  alter- 
natives simplifies  tne  cost  model  oecause  parameters  that  might  normally  be 
included  in  tiie  model  can  be  ignored  if  they  are  invariant  over  the  architec- 
tural alternatives. 

The  second  and  tnira  steps  (descrioe  and  evaluate  tne  alternatives)  fall 
witnin  the  domain  of  the  cost  model. 

The  fourth  step,  consider  tne  irreducibles,  can  be  an  important  part  of  the 
decision  process.  By  irreducibles  we  mean  attributes  of  the  alternatives  that 
have  not  oeen,  or  cannot  be,  quantitatively  described  by  the  model.  An  example 
of  an  irreducible  is  the  willingness  of  each  manufacturer  to  assist  in  verifying 
and  establishing  his  architecture  if  it  is  selected.  The  final  decision  on  the 
most  desirable  alternative  snould  consider  irreducioles  in  inverse  proportion  to 
the  size  of  tne  model -generated  cost  differences  between  the  alternatives.  The 
smaller  tne  differences,  the  more  consideration  should  be  given  to  irreducibles. 
Volume  eight,  final  selection,  discusses  the  irreducibles  relevant  to  the  CFA 
project. 

b.  THE  BASIC  I'iUUEL 


The  principal  output  of  tne  model  is  a two-dimensional  matrix,  R*,  wnose 
elements.  j=l,  ...n  , k=l,  ..H-.  give  the  discounted  cumulative  cost  of 
architecture^k  relative  to  a reference  architecture  for  a period  of  j years. 


Here  n denotes  the  maximum  time  period  in  years  and  N the  number  of  architec- 
tures under  examination.  An  element  is  called  a discounted  cumulative 
cost  ratio.  If  the  model  yields  R*,  then,  neglecting  irreducibles, 

architecture  1 is  more  desirable  tnan  arcnitecture  'I  for  the  period  j=l  through  j=m. 


since  it  has  a lower  cumulative  cost  for  that  period. 


The  study  described  herein  examines  cumulative  costs  over  periods  of  one  to 
thirteen  years  (N^=13)  beginning  in  197ti.  Cumulative  costs  were  calculated  only 
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up  to  19!#u,  Decause  of  the  increasing  difficulty  of  estimating  meaningful 

values  of  input  parameters  with  time.  Since  this  study  compares  only  three  archi- 
tectures, we  have  Ng=3.  The  index  k=l  represents  the  IBM  S/37U  computer  family 
arcnitecture  (the  reference  architecture),  k=2  the  Digital  Equipment  Corporation 
i'UH-11  architecture,  and  k=3  the  Interdata  B/32  architecture. 


Tne  model  obtains  the  yearly  architecture- dependent  cost  (C  . ) by  summing 
the  architecture-dependent  hardware  costs  (djj^)  and  software  costs 


“jk 


'jk 


(3.11 


The  nondi scounted  cumulative  cost  through  year  m for  architecture  k,  is 


simply  the  sum  of  all  costs  from  year  1 through  year  m. 


mk 


m 

^ ^Jk 
j=l 


(3.2) 


Tne  discounted  cumulative  cost,  D*^,  on  the  other  hand,  takes  into  ac- 
count the  time  value  of  money.  Since,  ignori ng  inflation,  a dollar  today  is 
worth  more  than  a dollar  tomorrow,  the  model  multiplies  cash  flows  occurring  in 


a year  j by  a discount  factor,  d^,  and  sums  the  products, 

in 

“mk  ■ 


(3.3) 


Eacn  discount  factor  is  an  average  over  the  year  j of  tne  single-payment 
present-worth  factor  w~^,  where 

w = 1 + q/lUU  (3.4) 

and  q is  the  annual  discount  rate  in  percent.  More  specifically,  d-  is  given 
oy  3 


(3.b) 


= (w^'3-w"'^)/ln(w) 

These  discount  factors  are  the  same  as  those  recommended  in  LAFR--Dy]  and 
used  in  LSADPR74,  Volume  V]. 

Since  our  immediate  interest  is  only  in  the  relative  merits  of  the  three 
architectures,  their  cumulative  cost  ratios  provide  an  adequate  and  useful 
measure.  In  addition,  the  cost  ratios  are  more  useful  than  absolute  costs 
because  they  serve  to  cancel  out  common  and  possioly  unknown  multiplicative 
factors. 
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Talcing  arcnitecture  one  (the  IBM  S/370)  as  the  reference  architecture,  we 
aefihe  the  nonoiscounted  cumulative  cost  ratio  as 


ana,  analogously,  the  oiscounted  cumulative  cost  ratio  as 
«jK  = V^jl- 


Consequently,  we  have  ” '^jl  * ^ 

(1)  Architecture-Uependent  Hardware  Costs 

The  model  ootains  the  architecture-dependeht  hardware  costs  oy 

summihg  the  architecture-dependeht  processor  (Pji,),  main-memory 
and  secondary-memory  expenditures,  ^ ^ 


jx 


^ 'Jx- 


(3.tt) 


The  following  sections  descrioe  the  method  of  arriving  at  values  for 
these  expenditures. 


(a)  System  development  Cycle  and  Yearly  Hardware  Expenditure  j 

Total  yearly  naraware  expenditures,  B.,  j = l ...N  , for  CFA-related  niili-  1 

tary  computer  systems  are  xey  inputs  to  the  model.  They  include  computer,  main-  ^ 

memory,  secondary-memory,  I/O  ana  peripheral  devices,  and  related  expenditures. 

Estimating  realistic  values  for  b.,  j=l,  ...N  is  a proolem  since  both  j 

the  number  of  dollars  that  will  be  spent  on  future^DoL)  military  computer  systems  1 

ana  the  fraction  of  these  dollars  that  will  fall  under  the  jurisdiction  of  the 
CFA  project  are  unXnown  at  this  time.  Fortunately,  however,  the  relative  merits 
of  the  competing  architectures  as  measured  oy  the  model  are  insensitive  to  multi- 
plying all  the  yearly  hardware  expehditures,  B.,  j=l,  ...N  by  the  same  cohstant  i 

because,  heglectihg  the  relatively  small  yearly  support-software  expenditures,  the 
constant  divides  out  of  the  model's  equations  when  we  compute  the  total  cumulative- 
cost  ratios.  The  relative  amount  spent  for  hardware  in  a given  year  as  compared 
with  other  years  is  a more  importaht  figure. 

Military  systems  typically  require  years  between  initiation  of  development 
and  full  deployment.  Tnis  phasing-in  period  is  estimated  to  be  approximately 
equal  to  average  system  development  cycle  time,  which  experience  indicates  runs 
between  3 and  10  years  LKossA7b],  LChap073],  LFremA7b],  [Boehfl73b,  p.  15].  In 

order  to  approximate  the  expenditure  levels  during  tnis  phasing-in  period,  we  ' j 

assumed  that  the  expenditures  b-,  j=l,  ..  N , began  at  some  predetermined  level,  j 

•’  ' ,1 

i 


I 
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B,,  increased  linearly  witn  time  over  an  initial  development  period  (B-,  j=1, 
and  then  remained  constant  for  the  remaining  period  (B,,  j=N^+i, 

..NT.  For  the  purpose  of  the  study,  the  development  period,  N^,  was  estimated 
to  oe  seven  years.  The  sensitivity  studies  (Cases  31  and  32)  also  considered 
tne  effects  of  cnoosing  development  periods  of  five  and  ten  years,  assuming  the 
same  initial  and  final  hardware  expenditure  levels.  Tne  simplifying  assumption 
of  constant  oase  hardware  expenditures  after  an  initial  development  period  ap- 
pears to  oe  reasonable  because;  (1)  total  ADP  expenditures  in  DoD,  when  measured 
in  uninflated  dollars,  have  been  nearly  constant  in  recent  years;  (2)  the  prin- 
ciple of  level  funding  has  tended  to  guide  Oou  budget  allocations;  (3)  decreasing 
hardware  costs  on  a per-unit  basis  have  tended  to  offset  increasing 
nardware  requirements;  and  (4)  the  exact  dollar  assumption  used  is  less  important 
than  its  equal-handed  application  to  each  of  the  candidate  architectures. 

Altnougn  tiiey  are  few  and  far  between,  there  are  some  estimates  and  projec- 
tions of  computer  system  oudgets  available  today  LFisnt)74,  BoenB72,  SADPR74, 
withF7bj.  For  our  purposes,  one  of  the  more  useful  was  D.  A.  Fisher's  study  of 
AUP  costs  in  uou  LFish074].  In  this  report,  Fisner  estimated  that  in  FY  iy73, 

Jou  spent  fa. 2 to  a. 3 billion  dollars  on  ADP.  He  found  that  approximately  one 
tnird  of  this  amount  originated  in  each  service,  and  that  about  lfa%  of  the  total 
went  to  computer  nardware,  4bfc  went  to  software,  and  3b%  to  other  AUP  costs,  such 
as  support  and  supplies,  keypunching,  and  computer  operation.  Using  these  figures, 
we  deduce  that  l.u  uo  1.3  billion  dollars  went  to  computer  narcfware  and  roughly 
2.6  to  3.7  oil  lion  dollars  went  to  software.  During  a private  conversation  with 
tne  author  in  May,  iy7o  LFishD7o],  D.  Fisher  mentioned  that  his  recent  studies 
snowed  tnat  if  one  were  to  divide  UoU  software  costs  oy  application,  the  major 
portion  (approximately  6b%)  goes  for  embedded  computer  systems,  i.e. , tne  types 
of  systems  the  CFA  project  is  designed  to  influence.  Approximately  19%  goes  for 
administrative  data  processing  applications  wherein  COBOL  is  the  principal  lan- 
guage, and  b*  goes  to  scientific  applications  using  most  commonly  FORTRAN.  The 
other  20%  goes  for  otner  types  of  applications  and  indirect  costs.  Assuming 
these  percentages  also  applied  in  FY  1973,  this  would  mean  that  of  the  approxi- 
mately 2.6  to  3.7  oillion  tnat  went  to  software,  about  l.fa  to  2.1  billion  went 
for  software  for  embedded  computer  systems.  If  we  make  the  assumption  that  the 
software-to-hardware  cost  ratio  for  embedded  computer  systems  is  approximately  the 
same  as  tnat  for  overall  Oou  AUP  systems,  we  obtain  U.fa  to  U.7  billion  dollars  for 
haroware  for  embedded  computer  systems.  Dividing  this  by  three  to  obtain  an  esti- 
mate of  cost  for  eacn  service,  we  obtain  U.2  to  U.23  billion.  Of  course,  not  all 
embeddeo  computer  systems  will  be  impacted  by  CFA.  Making  tne  very  rough  assump- 
tion that  one  fourtn  would  oe,  we  obtain  a yearly  annual  hardware  expenditure  rate 
for  a single  service  of  about  bU  million  dollars.  For  the  purpose  of  our  study,  we 
took  this  figure  as  our  nominal  hardware  expenditure  level.*  We  also  assumed,  based 
on  the  seven  year  pnase-in  period  described  earlier,  that  the  initial  hardware  ex- 
penditure was  about  one-seventh  of  this,  or  7 million  dollars.  In  summary,  for  most 
of  the  cases  reported  in  tnis  study,  we  assumed  the  yearly  base  haroware  expendi- 
tures will  remain  constant  at  fifty-million  dollars  after  linearly  increasing  over 
a seven-year  development  period  from  approximately  seven  million  dollars. 


*As  pointed  out  earlier,  the  overall  expenditure  level  assumed  is  immaterial 
since  it  is  the  comparative  (not  absolute)  costs  that  are  being  computed. 


^3)  Nominal  Yearly  Processor  Expenditures 

The  model  assuines  that  the  nominal  yearly  processor  expenditures  are 
constant  (u)  times  the  yearly  base  hardware  expenditures  (B-),  ^ 

J 

Kj  = udj.  (i.9l 

Nominal  processor  expenditures  (<■)  comprise  the  nominal  CPU  (p^)  and 
nominal  main  memory  (rt.)  expenditures  out  exclude  expenditures  tor  I7O  busses, 
devices,  ana  other  peripheral  gear  whose  costs  are  insensitive  to  the  architec- 
ture of  tne  processor, 

K = P + iv|..  (3.1U) 

J J J 

Ne  assumea  in  most  cases  that  the  constant  u was  u.b;  that  is,  we  took  the 
total  yearly  CPU  and  main  memory  costs  to  oe  one-half  the  overall  CFA  baSe  haro- 
ware  expenditures.  This  assumption  roughly  agrees  with  a recent  survey  of  UP 

Dudgets  LMcLaR/o j . In  order  to  measure  the  sensitivity  of  tne  model  to  u,  we 

also  used  values  of  u.4  and  U.b  as  explained  in  Section  3. 

(b)  Yearly  Main  Memory  Expenditures 

Ttie  model  assumes  the  nominal  yearly  main  memory  cost  (MJ  is  a fraction 
(a)  of  the  nominal  yearly  processor  expenditures  ^ 

M = aK  . (3.11) 

J J 

based  on  data  on  military  computer  systems  found  in  [KossA7t)],  and  LSUC-7oa]  it 
appears  that  a usually  lies  between  U.b  and  u.b.  The  value  used  in  most  of  our 
calculations  was  u.bb. 

Although  nominal  main-memory  cost  is  not  architecture  dependent,  actual  main- 
memory  cost  is.  We  express  this  dependency  as  follows: 

The  two  coefficients,  p.  and  s,  , are  included  in  this  equation  because  the  cost 
of  memory  depends  upon  tne  efficiency  with  which  an  architecture  stores  programs 
as  well  as  the  rate  at  which  it  uses  memory  in  executing  them.  The  parameter  Sj^, 
the  hormalized  s-measure,  is  indicative  of  the  memory  space  required  to  represent 
a program  when  using  architecture  k.  This  space  ihcludes  all  the  storage  required 
to  represent  and  execute  the  program  exclusive  of  input/output  used  by  the  program 
(sihce  the  same  data  arrays  are  used  by  all  candidate  architectures).  Professor 
S.  Fuller  and  other  memoers  of  the  computer  science  department  of  Carnegi e-Mel  Ion 
University,  with  tne  assistance  of  Army  and  Navy  R/U  organizations,  obtained  the 
s-measures  and  also  the  m-  ana  r-measures  reported  below  by  programming  a set  of 
test  (benchmark)  programs  on  existing  machines  of  the  candidate  architectures  and 
tnen  normalizing  the  results  LFullS7b].  The  quantity  P|^  in  equation  (3.1^)  is  a 
cost-to-perforiiance  coefficient  for  arcnitecture  k which  the  model  obtains  by 
combining  the  normalized  m and  r-measures  as  follows: 

Pk  = (Vr^^  + Wm|^)^^3  (3.13) 
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The  m-raeasure,  m.  , is  a measure  of  the  traffic  between  main  memory  and  the 
central  processor  that  is  required  to  execute  a program  when  using  architecture 
K.  The  r-measure,  r.  , is  a measure  of  the  data  traffic  internal  to  the  cen- 
tral processor.  The^exponent  g follows  from  a general  relationship,  probably 
first  examined  by  Urosch  [GrosHbJ],  between  performance  and  cost,  i.e. , per- 
formance = K X cost".  Rein  Turn  [TurnR74]  gives  a value  of  g between  i and 
3;  the  SAUPR-ab  Study  Group  [SAUPR74],  using  more  recent  data,  argues  for  a 
lower  value  of  aoout  l.b.  Although  this  latter  value  was  used  in  most  of  our 
calculations,  we  also  investigated  the  effects  of  using  values  of  1 and  2 (Sec- 
tion b).  The  parameters  V and  W are  weighting  factors  for  the  r-  ana  m-measures. 
Their  sum  is  assumed  to  oe  one.  Because  the  values  obtained  for  the  r-  and  m- 
measures  are  almost  equal  for  each  of  the  candidate  architectures,  making  r. 
Insensitive  to  the  values  of  V and  W,  we  took  both  V and  W to  be  u.5. 

Tne  constant  a appears  in  equation  (B.i2)  because  parts  of  the  main  memory 
are  insensitive  to  computer  architecture  - in  particular,  the  portion  occupied 
by  data  arrays.  Tne  architecture  sensitive  fraction,  a,  is  called  the  main- 
memory  static-storage  ratio.  Most  of  the  calculations  assume  a equals  U.b.  The 
sensitivity  studies,  however,  also  examine  the  effects  of  using  values  of  U.7 
and  0.^. 

(c)  Yearly  Central  Processor  Expenditures 

The  nominal  yearly  and  architecture-independent  central  processor  expendi- 
tures (PJ  follow  from  combining  equations  (3.1U)  and  (3.11), 


'■j  ■ "-“’‘j- 


(3. HI 


The  actual  architecture-dependent  central -processor  expenditures  (pL)  are 
given  by;  ^ 


v’  = P P 
Jk  k j 


(d)  Yearly  Secondary  memory  Expenditures 


(3.15) 


Tne  model  assumes  the  nominal  secondary-memory  expenditures  (E.)  are  in- 
dependent of  nominal  processor  costs  (K-)  and  are  a fraction,  v,  of'^the  yearly 
base  hardware  expenditures  (B.),  i.e.,  ^ 

J 


'j  ^ ''“j- 


(3.1b) 


From  these  it  obtains  the  secondary-memory  expenditures  that  are  architecture- 
sensitive  by 


^jk  - 


(3.17) 
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The  constant  o,  the  secondary-mentory  static-storage  ratio,  is  analogous  to  the 
inain-inemory  static-storage  ratio  (a),  and  the  parameter,  Sj^,  is  the  normalized 
s-measure  discussed  in  Section 


Altnough  it  is  difficult  to  determine  the  value  of  v that  is  appropriate  to 
military  computer  systems,  its  value  is  not  critical  for  two  reasons:  (1)  v is 
small  (less  than  u.i:)  for  most  military  computer  systems  and  (d)  the  fraction  of 
V tnat  is  architecture  related,  i.e.,  the  secondary-memory  static-storage  ratio 
(o),  is  also  small  (less  than  0.<J)  [SOC-Za],  l.KossA7b].  Most  of  the  calculations 
of  tnis  study  take  v to  oe  u.l  and  o to  oe  0.2.  The  sensitivity  studies  discussed 
in  Section  j examine  the  effects  of  choosing  v equal  U.O  and  0.2  and  D equal  0.1 
and  0.3,  and  confinn  the  relative  insensitivity  of  the  model  to  uncertainties  in 
the  values  of  these  parameters. 


(2)  Architecture-uepenuent  Software  Costs 

For  architecture  k,  the  total  yearly  software  expenditure  of  eq.  3.1 

is  the  sum  of  the  yearly  support-software  expenditure  (Q.)  plus  tne  architecture- 
dependent  application-software  expenditure  (AjP^j^), 

■^Jk  = ^3  * Yjk 

(a)  Yearly  Support  Software  Expenditures 


»le  define  support  software  to  oe  software  tools  such  as  compilers,  loaders, 
linkers,  simulators,  assemolers,  sub-monitors,  operating  systems,  and  debug  pack- 
ages and  we  assume  tnat  the  amount  of  money  allocated  for  the  development  of  these 
tools  is  independent  of  the  architecture  chosen.  Hence,  tne  model  assumes  that 
support  software  will  be  developed  with  an  expenditure  of  Q-  dollars  for  each  year 
j where  j=l,  ...13.  For  the  cases  considered  in  this  paper,  we  let  value  U.  be 
constant  at  x million  dollars,  for  j=2  tnrough  13  and  Q,=0.  The  sensitivity  studies  • 
examined  the  effects  of  allowing  x to  range  from  zero  to  eight  million  dollars  in 
two  million  dollar  increments.  Although  x is  architecture  independent,  it  plays  a 
Qominant  role  in  determining  the  lowest  cumulative  cost  alternative.  Unless  an  ex- 
tremely small  CFA  program  is  envisioned,  e.g.,  b million  dollars  per  year  or  less, 
the  support- software  costs  will  oe  small  compared  with  appl ications-software  costs, 
and  probably  will  be  around  2 million  dollars  per  year. 

(b)  Architecture-Dependent  Applications-Software  Costs 


Tne  model  assumes  that  base  (or  nominal)  appl ications-software  expenditure  in 
year  j,  denoted  A.,,  is  a constant  (p)  times  the  yearly  base  hardware  expenditure, 

“j- 

Aj  = pBj  (3.19) 

For  lack  of  a better  name,  we  call  p the  software- to- hardware  ratio.  Working 
with  the  reports  of  Fisher  [FishD74],  and  others  [WithR75],  LTurnR74],  [BoehB72], 
Li*lcLaR7b],  LSAUFR74],  we  estimate  p to  be  about  2.b  to  3 for  general-purpose  DoD 
computer  systems,  and  possibly  1/2  to  2 for  embedded  (tactical)  systems  [Cnap(j73], 
wnich  usually  have  multiple  deployments  of  the  same  software  and  hardware  and  do 
not  nave  software  bundled  into  the  system  price. 
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The  constant  p is  one  of  tne  most  crucial  parameters  in  the  model.  Because 
of  its  importance  and  because  of  tne  difficulty  of  estimating  its  value,  we  deter- 
mined the  cumulative-cost  ratios  for  19B5  and  199U  using  values  of  p of  1/8,  1/4, 
\rt,  1,  L.,  and  4.  Figures  3-1  and  6-1  show  the  results  of  these  calculations  for 
support-software  expenditures  (tj.)  of  two  million  dollars  and  clearly  illustrate 
tne  importance  of  p in  determining  the  most  cost-effective  computer  family  archi- 
tectu re. 

At  this  point,  a word  of  warning  appears  to  be  necessary.  The  sensitivity 
studies,  to  oe  described  in  Section  3.3,  snow  that  the  expected  uncertainties  of 
the  values  of  the  input  parameters  can  result  in  substantial  uncertainties  in  the 
cumulative  cost  ratios.  They  imply  that  the  reader  should  interpret  the  PDP-11 
and  Interdata  6161  curves  of  Figures  3-1  and  3-2  as  ribbons  having  widths  on  the 
order  of  twenty  to  thirty  percent  of  the  illustrated  values;  the  choice  of  the 
most  desirable  arcnitecture  for  values  of  p between  1/4  and  2 (the  values  expected 
in  the  military  computing  environment)  is  by  no  means  clear.  As  a consequence, 
the  final  decision  should  examine  i rreduci bles. 


The  architecture-dependent  appl ications-software  costs,  mentioned  earlier, 
are  A-F-j^.  Here  F-  is  the  amount  of  base  (nominal)  applications-software  expendi- 
ture that  should  be  used  in  determining  the  actual  applications-software  cost  for 
architecture  k.  It  is  dependent  upon  the  available  support  software  for  architec- 
ture k in  year  j. 


In  order  to  derive  an  expression  for  F ..  we  began  with  the  curves  shown  in 
Figure  3-3.  These  curves  give  the  cost  per'^Riachi ne  language  instruction  as  a func- 
tion of  availaole  support  software.  One-hundred  percent  support  software  means 
that  an  "ideal"  set  of  software  tools  for  military  computer  systems  is  available. 

W.  Svirsky,  T.  Biles,  and  A.  Irwin  of  System  Development  Corporation,  West  Long 
beach.  New  Jersey,  generated  these  curves  on  the  basis  of  the  results  of  a ques- 
tionnaire sent  to  sue  project  managers  of  five  large  scale  {24K  to  BOOK  instruc- 
tions) command  and  control  software  efforts  [SDC76b],  [SvirW76].  The  program 
managers  responded  to  tne  questionnaire  by  providing:  the  cost  of  software  pro- 
duction, the  number  of  instructions  generated,  the  expected  percentage  increase 
in  project  cost  that  would  result  if  each  of  thirteen  software  tools  available  to 
them  had  not  oeen  used,  and  the  expected  percentage  decrease  in  project  cost  that 
would  result  if  an  ideal  software  tool  were  available.  Taking  the  median  of  the 
oest  and  worst  case  data  curves,  Svirsky,  Irwin  and  Biles  also  derived  curve  C. 

Tney  noted,  however,  that  the  curves  are  largely  judgmental  and  examples  can  be 
found  that  yield  costs  per  instruction  above  and  below  the  worst  and  best  case 
data.  Confirming  their  reservations,  we  note  that  the  values  of  cost  per  instruc- 
tion shown  in  Figure  3-3  are  lower  than  those  reported  by  Wolverton  [WolvR74]  and 
others  iBrooFTb],  LTabaM74],  LPremA7b].  Although  he  does  not  cite  any  figures, 
Manley  has  found,  and  gives  reasons  why,  in  general  the  cost  per  instruction  for 
embedded  computer  systems  is  significantly  higher  than  that  for  normal  data  pro- 
cessing systems  LManlJ74].  At  a September,  1973  symposium,  B.  Boehm  mentioned 
tnat  Air  Force  avionics  software  costs  something  like  $75  per  instruction  to 
develop,  and  tnat  maintenance  of  the  software  has  run  up  to  $4000  per  instruction 
L6oehB73j.  The  aosolute  cost  per  instruction  does  not  affect  the  Top  Down  model, 
however,  because  the  model  depends  only  upon  the  relative  cost-per-instruction  vs 
support  software,  as  opposed  to  the  aosolute  cost  given  by  the  curve. 
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wmmmm 


From  a graph  of  the  SUC  median  curve,  it  appeared  to  us  that  the  inter- 
polation function 


y(s')  = + (y|,,-y^)exp(-s7c) 


(3.<du) 


might  provide  a reasonably  good  fit.  Here  y is  the  dollars  per  machine  language 
instruction,  s'  is  the  support  software  availability  in  percent,  and  y , y..,  and 
c are  constants.  Insisting  that  this  function  pass  through  the  three  points 
(s',  y)  = (<!u,  Sd.ii),  (5U,  ly./b),  and  (au,  lU),  in  accordance  with  the  SDC  sup- 
plied curve,  we  obtained  y =1.4lyb,  y_=4y.lbl  and  c=4b.bl71.  riext  we  assumed 
tnat  ^ 


Fjk  = ic  y(s'). 


{i.ZD 


where  x'  is  a constant  wnose  value  is  determined  oy  the  additional  assumption 
that  wnen  tne  average  of  tne  available  support  software  of  tne  three  alternative 
arcMtectures  in  year  1,  call  it  s',  is  substituted  in  equation  (3.^:1)  for  s'  we 


snoulo  Obtain  F. 


Here  we  assume  s'  can  be  expressed  as 


Luu  (^n 


wnere  denotes  the  available  support  software  (measured  in  dollars)  in  year  j 
for  architecture  k,  and  the  dollar  value  of  a 1UU%  support-software  base  (or 
ideal  support-software  base)  for  architecture  k. 

Several  members  of  the  CFA  selection  committee  surveyed  the  industry  and  esti- 
mateo  values  for  tne  currently  existing  support-software  base  for  each  candidate 
architecture  and  also  estimated  T.  . The  values  they  came  up  with  were;* 


Currently  Available 
k Support  Software  Base  ($) 


IbH  370  1 
uEC  POK-11  d 
IHT  a/Ji!  3 


31.049M 

i;u.79om 

14.1UUM 


44.6U4M 

43. b93M 

44. U4UM 


making  the  assumption  that  the  currently  available  support-software  base 
values  given  above  could  be  used  in  the  model  for  U..  , k=l,  ..3,  we  obtained 
from  equation  i'i.ZZ)  that  s'  = 49.7,  and 


k'  = l/y(s') 


U.ObbOl 


(3.ii3) 


*i«t  denotes  millions.  See  Appendix  b,  Section  3.7  for  corrections  to  these  figures. 
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Figure  3-3  shows  the  results.  Expressing  as 


we  have 


and 


=i;.i4bl. 


i 

t 

1 


(3.i!b) 

(3.^b) 

(3.27) 


The  dollar  value  of  the  available  support  software  in  year  j for  architecture  k, 

Uji^,  is  given  oy 

j 

"j«“  "'«*  f. 

Itl=2 

Where  is  dollar  expenditure  for  support  software  in  year  m. 

The  values  of  ^ have  a significaht  impact  oh  the  results  of  the  model. 
Demohstrating  this  impact.  Figures  3-4  and  3-5  show  discounted  total  cumulative 
cost  ratios  for  196t)  ahd  ibbU.  The  cases  showh  assume  that  Q™  = x for  in=2,  ...13 
and  that  x ranges  from  d to  d million  dollars  in  2 million  dollar  increments,  and 
that  p varies  by  doubling  from  1/6  to  4.  Figures  3-1  and  3-2  are,  of  course,  sub- 
sets of  these  results.  These  figures  show  that  by  increasing  support-software  ex- 
penditures we  can  effectively  counter  high  values  of  p that  may  be  characteristic 
of  certain  computing  environments.  They  also  show  that  as  support-software  expen- 
ditures increase,  the  differences  between  the  three  candidate  architectures  decrease. 
For  low  values  of  p the  Interdata  6/32  appears  most  desirable,  for  high  values  of  p 
the  IBM  S/37U  appears  to  be  the  best  choice;  for  intermediate  values  of  p (between 
i/4  and  1)  the  DEC  PDP-11  may  be  best.  As  mentioned  earlier,  because  of  the  uncer- 
tainties of  the  input  parameters,  these  results  should  be  interpreted  with  discretion. 

The  trend  from  case  4 to  case  5 (shown  in  figure  3-4)  may  at  first  appear  a 
little  perplexing.  It  indicates  that  if  we  increase  the  expenditure  rate  for 
support  software  development,  the  PDP-11  and  Interdata  8/32  get  worse  relative  to 
the  IBM  S/370.  One  might  guess  that  they  would  get  better.  The  reason  they  don't 
improve  is  because  a point  of  diminishing  returns  has  been  reached.  In  case  5 we 
are  spending  8 million  dollars  per  year  on  support  software,  when  the  maximum  base 
apolications  software  expenditure  is  only  6.25  million.  Hence,  the  amount  spent  on 
support  software  is  more  significant  than  the  amount  of  reduction  it  causes  in  ap- 
plications software  expenditures.  Since  the  cumulative  hardware  costs  for  the 
Interdata  and  DEC  are  lower  than  the  hardware  costs  of  the  IBM  S/370,  increasing 
the  support  software  expenditure  in  this  manner  only  makes  them  appear  worse, 
rather  than  better. 
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Figure  3*4 


1990  DISCOUNTED 
CUMULATIVE  COST  RATIOS 


(3)  Arcnitecture-Uependent  License/tloyalty  Costs 

Architecture  license  fees  or  royalties  most  likely  will  have  to  be  paid  to 
the  selected  manufacturer  for  using  his  architecture  and  software.  These  may  be 
paid  in  a lump  sum  in  the  oeginning  or  as  a percentage  of  each  computer  as  it  is 
manufactured.  Since  they  are  expected  to  be  a relatively  small  fraction  of  the 
overall  life  cycle  costs,  the  model  does  not  account  for  them. 


(4)  Summary  of  Equations 

The  equation  numbers  of  this  section  are  those  used  in  the  previous  text. 
For  j = 1,  ..Ny  and  k = 1,  ..N^ 


*j  ■ 

(3.iy) 

Kj  • . Hj  . uBj 

(3.y  and  3.1li) 

(3.11) 

P,  . (I-.)*, 

(3.14) 

■ ‘S  J 

(3.1b) 

^tn 

^ in=^ 

(3.2a) 

Sk  ~ ^jk  ^ ^jk 

(3.1) 

(3. a),  (3.1b),  (i.l2) 

"jk  = (^k  ^ ^ ^k'^Ej 

and  (3.17) 

Pk  = (Vrj^  + 

(3.13) 

^jk  ■ ^/jk 

(3.1a) 

•"jk  = ^m  ^ ‘ 

(3.Z4) 

m 

“^mk  ^ ^jk 

(3.2) 

J*1 


Pj^  cost-to-performance  coefficient  for  architecture  k 

S|^  the  normalized  s-measure  for  architecture  k 

a main-memory  static  storage  ratio 

0 secondary-memory  static  storage  ratio 

rj^  normalized  r-measure  for  architecture  k 
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"V 

V 

w 

9 


nonnallzed  m-measure  for  architecture  k 

weighting  factor  for  the  r-measure 

weighting  factor  for  the  in-measure 

exponent  of  cost  in  the  function  relating  perfor- 
mance to  cost. 


expenditure  for  support  software  development 
in  year  j. 


F 


jk 


f 


m 


f 


M 


h 


k 

mk 


w 


amount  of  base  (nominal)  applications-software 
expenditure  that  should  be  used  in  determining 
the  actual  applications  software  cost  in  year  j 
for  architecture  k. 

minimum  value  Fj|^  can  assume 

maximum  value  Fjj^  can  assume 

coefficient  relating  support  software  avail- 
ability to  rate  of  decrease  of  applications 
software  costs 

dollar  value  of  an  ideal  support  software 
oase  for  architecture  k 

the  nondi scounted  cumulative  cost  over  the 
years  1 through  tn  for  architecture  k 

the  discounted  cumulative  cost  over  the 
years  1 through  m for  architecture  k 

the  discount  factor  for  year  j 

factor  derived  from  the  annual  discount  rate 


q annual  discount  rate  in  percent 

R-  the  nondi scounted  cumulative  cost  ratio  of 

^ architecture  k relative  to  architecture  one 

for  a period  of  j years. 


m 


OV  = ^ C ...d. 

(3.3) 

d.  = (w^"'^-w"'^  )/ln(w) 

J 

(3.b) 

w = 1 + q/l(JO 

(3.4) 

«jk  = l^jk  / “jl 

(3.6) 

= “jk/  64 

(3.7) 

The  parameters  appearing  in  the  above  equations  are  orletly: 

j index  of  year  (l=iy7b,..,  U=lyyu) 

X index  of  architecture  (1:S/37U,  <^:PDP-11,  J: Inter- 

data b/3^) 

Ny  total  numoer  of  years  considered 

total  nunioer  of  architectures 

A.  base  (nominal)  applications  software  expendi- 

ture 


i3j  oase  (nominal)  hardware  expenditure 

p sof tware-to-hardware  ratio 


nominal  yearly  processor  cost 

nominal  yearly  central  processor  expenditure 

nominal  yearly  main  memory  expenditure 

main-memory  to  processor  ratio 

processor-to-Oase  hardware  expenditure  ratio 

secondary  memory-to-oase  hardware  expenditure 
ratio 

nominal  yearly  expenditure  on  secondary 
memory 

dollar  value  of  available  support  software 
in  year  j for  architecture  k 

dollar  expenditure  for  support  software 
development  in  year  m 

yearly  architecture-dependent  total  cost 

yearly  architecture-dependent  total  hardware 
cost 

yearly  architecture-dependent  total  software 
cost 

the  discounted  cumulative  cost  ratio  of  archi- 
tecture k relative  to  architecture  one  for  a 
period  of  j years. 
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c.  SENSITIVITY  STUDIES 

Figures  3-1,  3-2,  3-4  and  3-5  summarize  the  results  of  varying  the  software- 
to-hardware  ratio  (p  = 1/8*  1/4,  1/2,  1,2,  4)  and  the  support-software 
expenditures  (Q.  = 0,  1x10”,  2x10°,  4x10°,  SxlO**).  These  variations  constitute 
the  first  thirt^  cases  of  the  sensitivity  studies. 

All  of  the  sensitivity  studies  assume  the  discount  factor,  q,  is  ten  percent 
(the  value  recommended  by  tAFR--69]  and  used  in  [SADPR74]). 

Further  assessing  the  model's  sensitivity,  we  selectively  perturbed  individ- 
ual input  parameters  about  case  number  18's  (p=1  and  Q^=2xlo”)  input  data  set 
to  obtain  twenty-nine  additional  input  data  sets.  We  chose  the  case  18  data  set 
as  a reference  because,  at  this  time,  it  appears  to  be  the  most  reasonable  of  the 
first  thirty  data  sets  based  on  our  current  understanding  of  the  characteristics 
of  military  embedded  computer  systems,  the  candidate  architectures,  and  pr^'Dable 
success  of  CFA.  Tables  3-1  and  3-2  summarize  the  input  data  sets  for  casts  31 
through  59.  In  these  tables,  heavy  black  lines  set  off  the  parameters  that  we 
perturbed  from  the  reference  values  of  case  18. 

In  order  to  simplify  the  computations,  when  perturbing  the  fraction  of 
available  support  software  in  year  1,  U]|j/T|^,  we  assumed  the  parameter  that  the 
applications  software  scaling  parameter,  k',  remained  constant  at  the  value  it 
had  for  the  case  18  (reference)  data  set,  rather  than  change  it  according  to 
equations  (3.22)  and  (3.23). 
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Sensitivity  Studies 
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Sensitivity  Studies  (cont'd) 


Despite  this  simplification,  we  believe  the  resulting  perturbation  is  useful 
in  assessing  the  effects  of  uncertainties  in  the  support  software  availability. 
Also,  when  varying  the  s-measures  in  cases  51  through  53,  we  insisted  that  the 
sum  of  the  perturbed  s-measures,  which  we  call  s] , s^,  and  S3  in  Table  3-2, 
had  to  equal  the  sum  of  the  case  18  s-measures  (s^  =1.208,  S2  = 1.000,  S3  = 

0.828)  in  order  to  preserve  their  relative  normalization.  In^addition,  we  assumed 
that,  for  example  in  case  51,  when  the  s-nieasure  for  architecture  1 moved  up  by 
20%,  i.e.,  s|  = 1 .2  s^ , then  $2  and  S3  would  have  to  move  down  by  a common 
factor  that  would  allow  the  sum  to  remain  invariant.  In  particular,  we  insisted 
chat,  in  this  case. 


52  = S2t  (3.29) 

and 

53  = S3t  (3.30) 

where 

t = (Si  + S2  + S3  - s'l ) / ( S2  + S3)  (3.31) 

Table  3-2  also  shows  the  results  of  perturbing  S2,  S3,  m^ , m2,  m3,  r-) , r2,  and 
r3  in  an  analogous  manner. 

Figures  3-6  and  3-7  summarize  the  results  of  the  sensitivity  studies  (for  cases 
31  through  59)  for  1985  and  1990,  respectively.  The  dotted  lines  in  these  figures 
are  indicative  of  the  discounted  cumulative  cost  ratios  for  the  reference  data  set  . 
(case  18),  and  the  arrows  show  the  amount  and  direction  of  movement  from  these 
values  as  the  result  of  parameter  perturbation.  From  these  figures,  we  see 
uncertainties  in  the  percentage  of  the  ideal  support-software  base  available  in 
year  1 (Un^/Tv),  and  uncertainties  in  u,  the  ratio  of  yearly  processor  expendi- 
ture to  base  hardware  expenditure  (Kj/B^',  can  have  significant  impacts  on  the 
results.  ^ 

Appendix  A,  Section  3.6,  gives  some  of  the  input  parameters  and  all  of  the 
resulting  cumulative  costs  and  cost  ratios  generated  by  model  for  cases  1 
through  59. 


20=Ei/^in 


eo 

^ < 
T H 
_ Q.  < 

° 5 

fO  Cl-  c 

^ s 


o <1  n 


s a 


%03  dn 
%o:  dn 
%02dn 

%C3dn 
%oz  dn  ztu 
%ozdn  ‘uj 
%02  dn  *^8 
%oz  dn 

%02dn^s 

90-^i/^‘n 
^•o=3i/3in 
8‘0=‘l/‘‘n  D 
90='-i/“n 


g-anoAO  Ago 

30N3«3d5iJ 

__J I 

o o 


< O 
I 

<}-H  o 

I 

o 

< o 

I 

o 

L-*— (3  O 


< 

II 

o 

ha 

o 

- 5 

< 

II 

p 

d 

< 

1 

o 

- 5 

90=  n 

t 

1 

r< 

o 

— <N 

fr0=n  Q 

1 

— 1 

o 

e'o=q 

□ 

1 

<i 

1 

o 

— o 

i-o=q 

< 

1 

o 

- a 

01 

II 

O 

(O 

1“^ 

1 

o 

- a 

ro=E 

D-*! 

<J 

1 

o 

o 

Z = 6 

1 

1 

o 

— CO 
CO 

1 = 6 

I — »— c 

I 

1 

o 

ir> 

<n 

80  = ” 

1 

pva 

1 

< 

I 

o 

CO 

80  = '’ 

-1 

<H 

o 

CO 

o 

330AD  A3a 

ha 

<!i 

o 

— <N 
CO 

8 in 
<y> 
d 


Figure  3-6 
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CASE 


O IBM  370  19DO  DISCOUNTED  CUMULATIVE 

A DEC  PDP-11  COST  RATIOS 

Q INTERDATA  8/32 


CASE 


d.  ERROR  ANALYSIS 


Making  the  assumption  that  the  errors  in  the  measurements  of  the  model's 
parameters  are  normally  distributed,  the  variance  of  the  mean  of  the  calculated 
discounted  cumulative  cost  ratio  due  to  variances  of  the  means  of  the  model 
parameters  X , m=l,  ...N  , can  be  Approximated  by 
m p 


3r1\2 


^ / V 

'"=1  ' 3Xm  / 


(3.32) 


where  N is  the  number  of  parameters  under  consideration,  and  is  the  standard 
deviation  of  the  mean  of  the  parameter  X^^  [YounH62,  pp.  97-98]. 

In  order  to  obtain  the  partial  derivatives  in  Eq  (3.32)  two  alternative 
aooroaches  could  oe  taken.  The  first,  and  more  rigorous  aporoach.  would  be  to 
evaluate  tne  partials  analytically  from  the  equations  given  in  tne  main  body  of 
this  oaoer.  Although  this  approacn  would  be  straightforward,  it  would  result  in 
teveral  pages  of  comqlicated  exoressions.  To  evaluate  these  exoressions  we 
would  probably  find  it  most  efficient  to  write  a computer  program.  Writing  such 
a program  would  be  time  consuming  and  because  of  its  complexity,  highly  prone  to 
error.  Rather  than  take  this  route,  we  decided  to  use  the  second  approach,  which 
is  definitely  less  rigorous,  but  is  simpler  and  thus  quicker  and  significantly 
less  error  prone.  This  approach  approximates  the  partial  derivative  from  data 
already  obtained  by  the  sensitivity  studies.  The  sensitivity  studies  considered 
the  effects  of  varying  one  parameter  at  a time  about  a reference  data  set,  case 
18.  Along^the  direction  of  variation  of  this  parameter  we  can  assume  that  the 
function  R is  represented  by  a single  independent-variable  function  f.  The 
i noependenT*^variable  is  the  model  parameter  perturbed. 

Assume  we  have  evaluated  f at  three  points  Xq,  x , and  x . Then  the 
following  second-degree  polynominal  passes  through  thAse  points 


f(x)  = f[x ,]  + (x-xj  f[x  , X ] + (x-xo)  (x-x, ) f[x.,  X, , X ] 
1 1 1 0 1 2 1 0 


where 


f[x  , X ] = (f[x  ] - f[x  ])/(x  - X ) 

1 0 1 0 1 0 


f[x„,  X , X ] = (f[x  , X ] - f[x  X ])/(x  - X ) 

2 1 0 2 1 1 0 2 0 

By  differentiating  Eq.  (3.33)  with  respect  to  x and  evaluating  the  results  at 
X = x^  we  obtai n 


f'(x^)  = f[x^,  Xq]  + f[X2,  X^,  Xq]  (x^  - Xq) 


(3.34) 


1 


If  *2  ’ ’‘l  ” " ^0’  function  of  f is  sampled  at  equally  spaced 

points,  tften  Eq.  (3.34)  reduces  to 


= (f(x2)  - f(Xo))/(x2  - Xq) 
=f[x2,  Xq] 


(3.35) 


Assuming  the  value  of  x^  was  equal  to*the  reference  data  points  value,  we 
use  f‘(x. ) to  approximate  the  partial  of  R with  respect  to  x,  evaluated  at 
the  reference  data  point. 

For  example,  the  value  of  u,  the  nominal  yearly  processor  expenditure,  used 
in  the  reference  test  case  (case  18)  was  0.5.  Cases  41  and  42,  however,  also 
considered  the  effects  of  using  u equal  to  0.4  and  0.6.  Table  3-3  shows  the 
results  for  the  year  1985. 


IBM 

DEC 

I NT 

u 

★ 

«81 

0.4 

1 .00 

1 .10 

1.30 

0.5 

1 .00 

1.07 

1.23 

0.6 

1 .00 

1.04 

1.17 

Table  3-3 

Since  u was  measured  at  equally  spaced  points,  Eq  (3.35)  applies  and  we  can 
approximate  the  derivatives  of  R^,,  at  the  reference  data  point  (case  18)  by 

ok 


= 1.00  - 1.00  = 0 

3m  0.6  - 0.4 


= ■|•04  - 1.10  = 0.3 
3,.  0.6  - 0.4 


» 1.17  - 1.30  = 0.65 

^ 

3u  0.6  - 0.4 


Since  architecture  one  is  the  reference  architecture  the  partial  derivative 
of  R with  respect  to  any  parameter  will  always  be  zero. 

0 ^ 


i 


Table  3-4  summarizes  the  parameters  varied  in  the  sensitivity  studies, 
their  values  (X  ) in  the  reference  test  case  (case  18),  and  the  resulting 
partial  derivatives  calculated  using  Eqs.  (3.34)  and  (3.35)  for  the  year  1985. 
Equation  (3.35)  was  used  to  estimate  all  partials  except  those  with  respect  to 
p and  Q,  which  were  obtained  using  Eq.  (3.34).  No  calculations  were  made  for 
the  parameters  B through  B because  these  parameters  were  not  varied  in 
the  sensitivity  studies^  APmentioned  earlier,  however,  these  parameters  just 
about  completely  factor  out  of  the  equations  for  the  cumulative  cost  ratios  and 
thus  the  effects  of  their  errors  are  believed  to  be  relatively  insignificant. 


I 


Corresponding 

Model 

Parameter 


Value 


*DEC 


.INT 
3R  3X 
^83/  m 


By  - Bi3 


28.6x10 

37.5x10® 

42.5x10® 

50.0x10® 


Table  3-4 


-0.65 


+0.08 


-0.10 

+0.10 

-0.30 


^2 

'*3 

Uii/Ti 

U12/T2 

U13/T3 

P 

Q2-Q13 

B, 


0.828 


0.928 

0.850 


0.938 

0.825 

0.697 

0.474 

0.320 


7.14x10° 

14.3x10® 

21.4x10® 


+0.45 

+0.06 

-0.20 

+0.22 


+0.00 

+0.80 


+0.20 

-.04x10* 


+0.42 


+0.05 

+0.18 

-0.19 


+0.90 

+0.00 

-1.80 

+0.38 

-.08x10*^ 


not  calculated  not  calculated 


Digital 

Equipment  Corp. 

PDP-11 

Model 

Estimated 

Estimated 

m 

Parameter 

Value 

0 

m 

m 

1 

u 

0:50 

0.10 

0.0100 

2 

a 

0.65 

0.15 

0.0225 

3 

V 

0.10 

0.05 

0.0025 

4 

9 

1.50 

0.50 

0.2500 

5 

a 

0.80 

0.10 

0.0100 

6 

b 

0.20 

0.10 

0.0100 

7 

Si 

1.208 

0.24 

0.0576 

8 

^2 

1.000 

0.20 

0.0400 

9 

S3 

0.828 

0.16 

0.0256 

10 

mi 

1.266 

0.27 

0.0729 

11 

ni2 

0.928 

0.20 

0.0400 

12 

m3 

0.850 

0.18 

0.0324 

13 

'■1 

1.292 

0.28 

0.0784 

14 

^•2 

0.938 

0.20 

0.0400 

15 

•^3 

0.825 

0.18 

0.0324 

16 

Oii/Ti 

0.697 

0.15 

0.0225 

17 

U12/T1 

0.474 

0.10 

0.0100 

18 

^13''''’3 

0.320 

0.07 

0.0049 

19 

p 

1 

0 

0 

20 

^2*^13 

2x10^ 

0 

0 

21 

Bl 

7.14x10° 

0 

0 

22 

h 

14.3x10^ 

0 

0 

23 

B3 

21.4x10® 

0 

0 

24 

84 

28.6x10^ 

0 

0 

25 

B5 

37.5x10® 

0 

0 

2fc 

Be 

42.5x10® 

0 

0 

27 

B7  - Bi3 

50.0x10^ 

0 

0 

nc  - not  calculated 


Table  3-5 


0.090 
0.0049 
0.0025 
0.0064 
0.0400 
0.0000 
0.1764 
0.2025 
0.0036 
0.0400 
0.0484 
0.0000 
0.0361 
0.0441 
0.0000 
0.6400 
1 .3456 
0.0000 
0.0400 
1.6x10* 

nc 

lie 

nc 


Total  = 


a2 
•^82  m 


0.000900 

0.000110 

0.000006 

0.001600 

0.000400 

0.000000 

0.010161 

0.008100 

0.000092 

0.002916 

0.001936 

0.000000 

0.000092 

0.001764 

0.000000 

0.000466 

0.013456 

0.000000 

0.000000 

0.000000 

nc 

nc 

nc 


0.041999 


0.205 


INTERDATA  8/32 

Model 

Estimated 

Estimated 

0 

^ 0 

0 

0 

3 

3‘^r  a 

m 

Parameter 

Value 

m 

m 

■^83 

'^83  m 

1 

u 

0.50 

0.10 

0.0100 

0.4225 

0.004225 

2 

a 

0.65 

0.15 

0.0225 

0.0100 

0.000225 

3 

V 

0.10 

’ 0.05 

0.0025 

0.0100 

0.000025 

4 

9 

1.50 

0.50 

0.2500 

0.0100 

0.002500 

5 

a 

0.80 

0.10 

0.0100 

0.0900 

0.000900 

6 

b 

0.20 

0.10 

0.0100 

0.0025 

0.000025 

7 

*1 

1.208 

0.24 

0.0576 

0.1681 

0.009682 

8 

®2 

1.000 

0.20 

J.0400 

0.0225 

0.000900 

9 

*3 

0.828 

0.16 

0.0256 

0.1764 

0.004516 

10 

"l 

1.266 

0.27 

0.0729 

0.0400 

0.002916 

11 

^2 

0.928 

0.20 

0.0400 

0.0025 

0.000100 

12 

m3 

0.850 

0.18 

0.0324 

0.0324 

0.001050 

13 

''i 

1.292 

0.28 

0.0784 

0.0361 

0.002830 

14 

'"2 

0.938 

0.20 

0.0400 

0.0025 

0.000100 

15 

'*3 

0.825 

0.18 

0.0324 

0.0324 

0.001050 

16 

Uii/Ti 

0.697 

0.15 

0.0225 

0.8100 

0.018225 

17 

U12/T2 

0.474 

0.10 

0.0100 

0.0000 

O.OODOOO 

18 

^^13/^3 

0.320 

0.07 

0.0049 

3.2400 

0.015876 

19 

p 

1 

0 

0 

0.1444 

0 

20 

2x10^ 

g 

0 

0 

6.4x10"^^ 

0 

21 

h 

7.14x10 

0 

0 

nc 

0 

22 

82 

14.3x10® 

0 

0 

nc 

0 

23  . 

B3 

21.4x10® 

0 

0 

nc 

0 

24 

84 

28.6x10® 

0 

0 

nc 

0 

25 

^5 

37.5x10® 

0 

0 

nc 

0 

26 

B6 

42.5x10® 

0 

0 

nc 

0 

27 

®7  - Bi3 

g 

50.0x10 

0 

0 

nc 

0 

Total  = = 0.065145 


Table  3-5  and  3-6  explicitly  show  the  evaluation  of  Eq  (3.38).  They  give 
the  estimated  value  of  each  model  parameter  as  used  in  the  reference  test  case 
(case  18).  They  also  give  the  estimated  standard  deviation  ( o^j,)  of  the  mean  of 
each  parameter.  These  standard  deviations  were  obtained  by  the  method  of 
“educated  guess."  It  should  be  noted  that  the  standard  deviations  for  p and  Q. 
were  assumed  to  be  zero.  This  is  not  because  they  are  actually  zero  (in  fact.J 
they  are  quite  large)  but  because  we  desired  to  obtain  an  estimate  of  the  standard 
deviation  of  the  point  (p  = 1)  for  Figure  3-1.  This  figure  assumes  Q.  and  p 
are  known  exactly.  From  the  partials  given  in  Tables  3-4,  3-5  and  3-i  we  see, 
however,  that  if  the  errors  in  Q.  and  p were  included  in  the  calculations  they 
would  significantly  increase  th^resulting  value  of  o • 

The  results  of  these  calculations  indicate  that  the  uncertainties  in  the 
model's  major  results  are  quite  large.  Table  3-7  summarizes  the  findings  for  a 
software-to-hardware  ratio  of  one  (p  = 1)  and  support-software  expenditures  of 
two  million  dollars  per  year. 


k 

•k 

«8k 

GO 

D 

1 

IBM 

1 

1.00 

0.000 

DEC 

2 

1.06 

0.205 

I NT 

3 

1.22 

0.255 

Table  3-7 


These  results  imply  that  because  of  uncertainties  in  our  input  data  we  cannot 
really  resolve  the  question  of  which  architecture  is  the  most  cost  effective  for 
this  software-to-hardware  ratio  by  using  the  top-down  model.  As  a result, 
irreducibles  probably  should  play  a major  role  in  the  final  decision. 
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f.  APPENDIX  A - SUPPORTING  DATA 


This  appendix  gives,  in  tabular  form,  some  of  the  input  parameters  and  all 
of  the  resulting  1985  and  1990  cumulative  costs  and  cost  ratios  generated  by  the 
model  for  Cases  1 through  59.  Its  contents  include: 


Table 

3-A.l 

Cases  1-30 

1985 

and  1990  Cumulative  Costs 

3-A.2 

Cases  1-30 

1985 

and  1990  Cumulative  Cost  Ratios 

3-A.3 

Case  3 

P=l/8 

, Detailed  Data  and  Results 

3-A.4 

Case  8 

p=l/4 

, Detailed  Data  and  Results 

3-A.5 

Case  13 

P=l/2 

, Detailed  Data  and  Results 

3-A.6 

Case  18 

P=l, 

Detailed  Data  and  Results 

3-A.7 

Case  23 

P=2. 

Detailed  Data  and  Results 

3-A.8 

Case  28 

P=4, 

Detailed  Data  and  Results 

3-A.9 

Cases  31-59 

1985 

and  1990  Cumulative  Costs 

3-A.lO 

Cases  31-59 

1985 

and  1990  Cumulative  Cost  Ratios 

Table  3-A,2  follows  from  the  data  in  Table  A.l.  Figures  3-1,  3-2,  3-4  and 
3-5  graphically  summarize  the  information  in  Table  3-A.2. 

Tables  3-A.3  through  3-A.8  show  detailed  input  data  and  results  for  Cases 
3,  8,  13,  18,  23  and  28.  These  correspond  to  Q.=2xl0°,  j=2,  ...13,  and 
'’=!/€,  1/4,  1/2,  1,  2 and  4.  In  these  tables,  ^he  values  in  row  1 are  A., 
j=l,  ...13.  Row  2 shows  B.,  j=l , ...13.  Rows  2,  3,  4 show  the  total  yearly 
software  costs  (S  ) given^by  equation  (3-18),  where  k=l  means  IBM,  k=2  means 
DEC,  and  k=3  mean4*^ Interdata.  Rows  6 through  8 give  the  yearly  hardware  costs 
(H  ) oT  equation  (3.8).  Rows  9 through  11  give  the  total  nondiscounted 
cuAolative  costs,  as  obtained  from  equation  (3.2).  Rows  12  through  14  give  the 
total  nondiscounted  cumulative  cost  ratios,  R , of  equation  (3.6).  Rows  15 
through  20  give  the  corresponding  discounted  46sts  and  ratios  of  equations  (3.3) 
and  (3.7).  Row  21  gives  the  discount  factors,  d.,  obtained  by  applying  equa- 
tion (3.5)  for  a discount  rate  (q)  of  10%,  the  vllue  recommended  in  [AFR — 69]. 

Tables  3-A.9  and  3-A.lO  prtivide  the  (nondiscounted  and  discounted) 
cumulative  costs  and  cost  ratios  (for  1985  and  1990,  cases  31-59).  Figures  3-6 
and  3-7  graphically  summarize  the  data  in  Table  3-A.lO. 
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Ratios  of  Total  Ratios  of  Total  Ratios  of  Total  Ratios  of  Total 

Non-Di scounted  Discounted  Non-Di scounted  Discounted 
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Table  3-A.9 


Total  Non-Discounted  Total  Discounted  Total  Non-Discounted  Total  Discounted 

Cumulative  Cost  Cumulative  Cost  Cumulative  Cost  Cumulative  Cost 

Ratios  Ratios  Ratios  Ratios 


a.  APPEMOIK  B - CORRECTIOMS  TO  CALCULATIONS  REFLECTING 
REVISED  SUPPORT  SOFTWARE  DATA 


At  the  7 October  1976  meeting  of  the  CFA  Publications  Subconmittee  held  at 
ECOM  headquarters.  Ft.  Monmouth,  New  Jersey,  Jim  Wagner  distributed  a paper 
describing  the  revised  results  of  the  evaluation  of  the  support  software  bases 
of  the  candidate  architectures  for  the  Military  Computer  Family  [WagnJ76].  Its 
support  software  base  results  were  different  from  those  reported  earlier  in  the  i 

mam  body  or  this  report.  Ihe  purpose  of  this  appendix  is  to  describe  the  main  i 

effects  of  these  differences. 


Figire3-B.l  summarizes  the  revised  software  bases  as  reported  in  [WagnJ76]. 
ngure  also  based  on  [WagnJ76],  gives  the  estimated  number  of  years  to 

correct  these  deficiencies  when  1,  2,  and  3 million  dollar/year  are  spent  on 
support  software  development. 


Software  Base  and  Deficiency  Comparison  (M=10^  dollars) 


Percent 

Existing  Base 

Deficiency 

Total 

Availability 

IBM  32.269M 

9.595M 

41 .864M 

77.08 

DEC  22.22Uf1 

19.130M 

41.350M 

53.74 

IMT  15.360M 

25.970M 

41.330M 

37.16 

Figure  3-B.l 

Years  to  Correct  Deficiencies 
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Figure  3-B.2 
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Using  the  values  given  in  Figure3-B.l,  and  in  some  cases  applying  the 
expressions  described  earlier,  we  obtained  new  input  values  for  some  of  the 
parameters  in  the  model; 


Parameter 

Old  Value 

New  Value 

^1  • 

31.049M 

32.269M 

'l2 

20.079M 

22.220M 

'l3 

14.100M 

15.360M 

^1 

44.604M 

41 .864M 

^2 

43.893M 

41.350M 

^3 

44.040M 

41 .330M 

s’ 

49.7 

55.99 

k’ 

0.05601 

0.06337 

f 

0.0795 

0.08996 

m 

f 

2.7528 

3.11464 

M 

In  the  earlier  calculations,  Q.,  the  support  software  expenditure,  was 
assumed  co  be  a constant  two  millioA  for  the  years  J=2  through  13  (for  most  of 
the  cases).  The  following  calculations  improve  upon  this  assumption  by  making 
better  use  of  the  data  provided  in  [WagnJ76].  In  particular,  we  see  from  Figure 
3-B.2  that  if  we  spend  two  million  per  year  it  actually  takes  eleven  years,  or 
twenty-two  million  dollars,  to  correct  a 19.30  million  dollar  deficiency  in 
support  software.  This  implies  that  in  this  case  the  dollar-effectiveness  factor 
is  (19.13/22)  or  0.870  for  the  POP-11.  The  comparable  figures  for  the  Interdata 
8/32  and  IBM  360/370  are  0.866  and  0.872,  respectively.  To  account  for  these 

effects  in  the  revised  calculations  we  replaced  in  Eq.  (3.24)  by 

where  y(1)  = 0.872,  t(2)  = 0.870,  and  y(3)  = 0.866.  Also  we  replaced  Qj  by  in 
Eqs.  (3.18)  and  (3.28)  and  for  the  $2  million  dollar  expenditure  rate,  let  the 
0 matrix  be  zero  except  for  the  following  elements: 

J ^ 

= 2x10^  , j=2,  ...7 
0j2  = 2x10^  , j=2.  ...12 
Qj3  = 2x10^  , j=2,  ...16 

The  earlier  calculations  had  assumed  Q would  be  constant  for  all  years, 
except  the  first,  and  thus  didn’t  take  into^account  the  fact  that  once  the 
support  software  deficiency  had  been  corrected  further  expenditures  would  not  be 
necessary. 
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Figures  3-B.l  and  3-B.2,  and  Tables  3-B.l  through  3-B.6  sunmarize  the 
revised  results  for  cases  3,  8,  13,  18,  23,  and  28.  Table  3-B.7  gives  the 
results  of  assuming  a software- to-hardware  ratio  of  eight. 

Comparing  the  revised  results  shown  in  Tables  3-B.l  through  3-B.7  with 
Figures  3-1  and  3-2,  of  the  main  text  of  this  paper,  we  see  the  corrections 
have«  relatively  insignificant  effect  on  the  cost  ratios  reported  earlier. 

VlagnJ76  Wagner,  J.,  et.  a1.,  "Procedure  for  and  Results  of  the  Evaluation  of 
the  Software  Bases  of  the  Candidate  Architectures  for  the  Military 
Computer  Family,"  6 August  1976.  Prepared  by  the  Software  Evaluation 
Methodology  Subcommittee. 
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Year  Case  3 (19  Oct  76) 
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Year  Case  8 (19  Oct  76) 
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Year  Case  13  (19  Oct  76) 
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Table  3-B.7 


4.  CUMCLUSIONS 


Tne  two  models  serve  as  cnecKs  against  one  another.  The  oottom-up 
results  indicate  that  in  most  circumstances  the  DEC  FDP-11  is  superior  to 
Doth  tne  IBM  S/37U  and  Interdata  o/3^  architectures.  The  top-down  model 
results,  on  tne  other  hand,  indicate  that  the  S/37U  is  superior  for  high 
(greater  than  one)  software-to-hardware  cost  ratios,  while  the  Interdata  8/32 
is  slightly  better  for  low  (less  than  one-fourth)  ratios,  and  the  PDP-11  is 
best  in  between.  These  apparently  conflicting  results  were  found  to  be  due 
to  uncertainties  in  the  input  data,  to  different  input  requirements,  to  con- 
trasting basic  model  assumptions,  and  to  different  methods  of  combining  the 
same  input  data. 

For  example,  the  bottom-up  model  weights  the  raw  S,  M,  and  R data,  pro- 
vided by  CMU  for  tne  individual  test  programs,  according  to  the  estimated 
relevance  of  each  program  in  each  system  application.  It  then  combines  these 
into  the  composite  processor  speed  and  static  storage  ratios,  a^j,  and  b.  .. 

Tne  top-down  model,  on  the  other  hand,  uses  composite  S,  M,  R ratios,  which 
were  derived  oy  CMU  from  tne  individual  S,  M,  R measures  for  each  test  program 
and  wnicn  were  weignted  by  CMU  to  obtain  minimum  statistical  variance  in  these 
ratios  rather  than  to  reflect  the  importance  of  particular  application  pro- 
grams. A result  of  these  two  different  approaches  to  using  the  individual 
test  program  S,  M,  and  R data  is  a difference  in  the  computed  architectural 
efficiency  of  tne  Interdata  8/32  as  compared  to  the  POP-11.  In  the  first  case 
tney  are  comparable,  in  the  second  the  8/32  is  superior.  A further  result  of 
tnis  difference  is  that  if  the  unweighted  S,  M,  and  R data  are  used  in  the 
bottom-up  model,  tnen  the  8/32  becomes  the  superior  architecture  in  the  1976 
calculations  when  the  hardware-software  cost  ratio  is  high.  This  agrees  with 
tne  top-down  model  results.  Conversely,  if  the  S,  M,  and  R data  used  in  the 
top-down  model  were  weighted  as  in  the  bottom-up  model,  better  agreement  be- 
tween the  models  would  result. 

As  another  example,  the  assumptions  leading  to  the  ratio  of  software  costs 
to  nardware  costs  are  clearly  among  the  most  important  to  the  ultimate  results, 
wnile  at  the  same  time  are  among  the  most  difficult  to  support  with  actual  data. 

The  uncertainty  calculations  in  Section  3.4  for  the  top-down  model  could 
oe  applied  to  the  bottom-up  model  with  similar  results  expected.  Because  of 
the  size  of  these  uncertainties,  the  results  of  the  models  must  be  interpreted 
with  caution.  By  chance,  each  of  the  three  architectures  evaluated  had  either 
superior  hardware  attributes  (the  8/32),  or  superior  software  attributes  (the 
S/370),  or  a good  combination  of  the  two  (the  PDP-11).  As  a result,  the  com- 
bined hardware-software  effectiveness  of  the  three  architectures  were  relatively 
close.  Probably  the  strongest  conclusions  to  be  derived  from  the  life  cycle 
cost  evaluations  are  that,  within  the  uncertainties  resulting  from  propagating 
errors  in  the  input  data  throughout  each  models  calculations,  (1)  tne  models 
agree  and  (2)  all  three  architectures  would  be  comparable  choices  based  on 
life-cycle  costs. 
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